Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.234836865s FAIL (2025-09-03 00:47:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.234865441s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.046576574s FAIL (2025-09-03 00:46:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.046596352s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.026757511s FAIL (2025-09-03 00:45:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.026780313s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.071471727s FAIL (2025-09-03 00:45:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.071493428s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.200137777s FAIL (2025-09-03 00:45:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.200158296s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.234280099s FAIL (2025-09-03 00:43:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.234301068s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.335462667s FAIL (2025-09-03 00:42:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.335484238s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.217339577s FAIL (2025-09-03 00:41:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.217354324s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.179769887s FAIL (2025-09-03 00:41:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.179790949s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.174821104s FAIL (2025-09-03 00:39:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.17484022s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.192660614s FAIL (2025-09-03 00:38:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.192683018s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000870353s FAIL (2025-09-03 00:38:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00088998s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.933972299s FAIL (2025-09-02 23:21:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.934003388s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.042280447s FAIL (2025-09-02 23:21:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.042303892s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.008780546s FAIL (2025-09-02 23:19:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.008798031s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.021380437s FAIL (2025-09-02 23:19:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.021407158s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.163642573s FAIL (2025-09-02 23:18:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.163667198s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.185790301s FAIL (2025-09-02 23:16:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.185809728s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.581351881s FAIL (2025-09-02 23:16:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.58140427s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.963985754s FAIL (2025-09-02 23:15:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.964014628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.037103406s FAIL (2025-09-02 23:14:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.037129927s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.176222636s FAIL (2025-09-02 23:13:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.176249748s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.231640381s FAIL (2025-09-02 23:12:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.231664317s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.152147953s FAIL (2025-09-02 23:12:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.152170747s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.518223341s FAIL (2025-09-02 23:11:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.518250122s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.062148756s FAIL (2025-09-02 23:10:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.062173746s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.278888998s FAIL (2025-09-02 23:10:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.278915539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.096340749s FAIL (2025-09-02 23:09:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.096382159s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.438504652s FAIL (2025-09-02 23:09:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.438528337s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.216246678s FAIL (2025-09-02 23:08:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.216274682s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.012929145s FAIL (2025-09-02 23:07:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.01295797s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.313143921s FAIL (2025-09-02 23:06:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.313170182s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.134822782s FAIL (2025-09-02 23:05:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.134852678s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.087621027s FAIL (2025-09-02 23:04:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.087651474s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.993175787s FAIL (2025-09-02 23:03:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.993202487s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.962179737s FAIL (2025-09-02 23:02:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.962206047s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.299452053s FAIL (2025-09-02 23:02:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.299478594s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.063024292s FAIL (2025-09-02 23:01:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.06304992s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.056949788s FAIL (2025-09-02 23:01:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.056982161s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.046206817s FAIL (2025-09-02 22:59:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.046229321s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.895767315s FAIL (2025-09-02 22:58:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.895794355s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.045555849s FAIL (2025-09-02 22:58:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.045583932s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.847603151s FAIL (2025-09-02 22:57:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.84762839s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.059859469s FAIL (2025-09-02 22:57:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.059966293s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.058299944s FAIL (2025-09-02 22:56:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.058326314s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.990342296s FAIL (2025-09-02 22:55:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.990363777s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.275906284s FAIL (2025-09-02 22:54:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.275933697s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.401491958s FAIL (2025-09-02 22:54:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.401525173s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.331995389s FAIL (2025-09-02 22:53:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.332009116s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.217129479s FAIL (2025-09-02 22:52:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 2 22:34:26.108285271 (104h26m22.78848084s) [upload=91865]: Starting upload Sep 2 22:34:26.108371626 (104h26m22.788567195s) [upload=91865]: Done starting upload Sep 2 22:34:26.108505612 (104h26m22.788701181s) [upload=91865]: Uploading segments... Sep 2 22:34:26.108575505 (104h26m22.788771074s) [upload=91865]: Got next segment. Inline: false Sep 2 22:34:26.108602697 (104h26m22.788798266s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 22:34:26.108607536 (104h26m22.788803105s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 22:34:26.640551803 (104h26m23.320747362s) [seg_pos={0 0}, upload=91865]: Begin upload segment... Sep 2 22:34:26.640594175 (104h26m23.320789734s) [seg_pos={0 0}, upload=91865]: Done begin upload segment. Sep 2 22:34:26.640623261 (104h26m23.32081883s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640631075 (104h26m23.320826644s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.640728131 (104h26m23.3209237s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641101215 (104h26m23.321296784s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.641760105 (104h26m23.321955674s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642070819 (104h26m23.322266389s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642358750 (104h26m23.322554319s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642608439 (104h26m23.322804008s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.642896990 (104h26m23.323092559s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643161186 (104h26m23.323356745s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643401776 (104h26m23.323597355s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643673676 (104h26m23.323869235s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.643885151 (104h26m23.32408072s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644124458 (104h26m23.324320027s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644336404 (104h26m23.324531973s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:26.644541096 (104h26m23.324736665s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Uploading piece... Sep 2 22:34:28.426399105 (104h26m25.106594674s) [upload=91865]: Next returned nil segment Sep 2 22:34:28.426429533 (104h26m25.106625102s) [upload=91865]: Waiting for error group managing segments... Sep 2 22:34:28.709319121 (104h26m25.38951469s) [noise=true , address=45.91.116.7:4011 , piece_id=7XQDTR5FPLU74WGSEGJRMT55QHWTFZRQWFCO7RH2JFJJIIDLX3KA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.742363861 (104h26m25.42255943s) [noise=true , address=45.91.116.4:4937 , piece_id=3E44FAAOEI7NFLN2VT4HLVSOBQHODXZQH6YJXL7HCLCTBND3GN6A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.755015766 (104h26m25.435211325s) [noise=true , address=77.90.31.18:4805 , piece_id=D7QKGFUAHBBWHP537X2I4I22IUFKXSLJLLDEFKSTETMPY5R46KFA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.762622820 (104h26m25.442818379s) [noise=true , address=104.36.82.8:4971 , piece_id=AN54JZGK6ERSZKPZ3N7XMD5WDKBJMFDK62TQTJOJLVCK4T2CP6MQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.767228641 (104h26m25.44742421s) [noise=true , address=45.91.116.12:4225 , piece_id=KVTX4XXLOD4XQMDEIVJFMFYILV2UX7ILH7PDKWGHONY4W7BCQQGA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.768297245 (104h26m25.448492814s) [noise=true , address=104.36.82.14:4223 , piece_id=DPLR62GDSJNEH57MDU66E2GUUUWZHEWJJVV3QGMOAHR6SXIES5DQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.775687885 (104h26m25.455883454s) [noise=true , address=45.91.116.10:4082 , piece_id=IV557EXYYYXTV6OLYDWXNQVZY7GXICURER6RX4HRAGSPGND724ZQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.808524997 (104h26m25.488720556s) [noise=true , address=77.90.31.15:4699 , piece_id=3MTMLLQB7WJXWQCSEMI4AKGAKZXOTDZWYXRMHFY5ZW3OOL7TU4EA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.822962548 (104h26m25.503158117s) [noise=true , address=45.91.116.6:4974 , piece_id=OSHERQ7HPXUIOV6ZO6NXOZ7EYVMTRHRITT2CM4T567GIUVW7NMSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.831597418 (104h26m25.511792987s) [noise=true , address=45.91.116.13:4155 , piece_id=FKJ2CVLGVIYQR26QNPV7ASYZRDX4AYPT5MTDHIECB2F2ZQETVCNA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857310711 (104h26m25.53750628s) [noise=true , address=45.91.116.9:4263 , piece_id=VQ7WUW3SABZP2WXWFRIVIEW3HUMTXDOM3BOFZTORSQGY5JXMCD2Q, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.857538176 (104h26m25.537733745s) [noise=true , address=77.90.31.10:4520 , piece_id=GMAUSELMQ7F5D6ZLR2L35MRDUUBP5RVIO266CCO5KJ2DIYK2YWSQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874257133 (104h26m25.554452692s) [noise=true , address=45.91.116.7:4010 , piece_id=RJYV3VXMUHNHOP4OZDGTCCSXGV26ZVOJF4LIA75XKZNLUUEFKERA, seg_pos={0 0}, upload=91865]: Done uploading piece. err: <nil> Sep 2 22:34:28.874280628 (104h26m25.554476197s) [seg_pos={0 0}, upload=91865]: Segment reached optimal threshold of 13 pieces. Sep 2 22:34:28.874436766 (104h26m25.554632335s) [noise=true , address=104.36.82.4:4803 , piece_id=ZV6CZTC6RQZFLZWNBF4OVKYJZYB6FTL2D6QQU7I7MVILT3I4OB7A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874451484 (104h26m25.554647053s) [noise=true , address=77.90.31.17:4770 , piece_id=EEU75WET3JF5J47AUVYJMAUFFP5KFAT4NZZTUP5XFHT6W2MEK2AQ, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874500868 (104h26m25.554696437s) [noise=true , address=104.36.82.6:4874 , piece_id=ICOS6YHX75A2FHFHY2AKXSTA5VYY5DAK3XP4XK5Q72B5WXVCXR5A, seg_pos={0 0}, upload=91865]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 22:34:28.874520125 (104h26m25.554715694s) [seg_pos={0 0}, upload=91865]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 22:34:28.874574900 (104h26m25.554770469s) [upload=91865]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 22:34:28.874579048 (104h26m25.554774617s) [upload=91865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 22:37:04.456175130 (104h29m1.136370699s) [upload=91865]: Done uploading segments... Sep 2 22:37:04.456197211 (104h29m1.13639277s) [upload=91865]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.217155881s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)