Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001848648s trace: https://jaeger.dev.storj.io/trace/265413194f323806 FAIL (2026-01-13 14:21:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001871961s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [X.X..XX........................X.X..X.X....X....X...........] duration: 18.354903755s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:21:40 UTC) orbiter warning: context deadline exceeded Duration: 18.354918483s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 49 out of 60 is failed (threshold=3) [XXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XXXXXXX..] duration: 28.470148839s trace: https://jaeger.dev.storj.io/trace/231e6afcfe7214e0 FAIL (2026-01-13 14:21:32 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.470163768s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...................X................] duration: 26.731875095s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:21:29 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 26.731899782s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.X.X..XX........................X.X..X.X....X....X..........] duration: 36.162635524s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:21:22 UTC) orbiter warning: context deadline exceeded Duration: 36.16296363s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000659361s trace: https://jaeger.dev.storj.io/trace/277e2e192df49b44 FAIL (2026-01-13 14:21:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000682795s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 50 out of 60 is failed (threshold=3) [XXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XXXXXXX.] duration: 23.49988589s trace: https://jaeger.dev.storj.io/trace/231e6afcfe7214e0 FAIL (2026-01-13 14:21:01 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 23.499899717s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001565216s trace: https://jaeger.dev.storj.io/trace/4e6a3f83caaf16d4 FAIL (2026-01-13 14:20:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00158833s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XXXXXXX] duration: 30.001758227s trace: https://jaeger.dev.storj.io/trace/231e6afcfe7214e0 FAIL (2026-01-13 14:20:38 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00177041s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [..X.X..XX........................X.X..X.X....X....X.........] duration: 19.348773556s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:20:38 UTC) orbiter warning: context deadline exceeded Duration: 19.348836174s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000823667s trace: https://jaeger.dev.storj.io/trace/3d1efb09590cd123 FAIL (2026-01-13 14:20:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000841992s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X...................X...............] duration: 6.759801098s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:20:15 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.7598281s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XXXXXX] duration: 30.001860711s trace: https://jaeger.dev.storj.io/trace/7e87a073f3ab01bb FAIL (2026-01-13 14:20:07 UTC) orbiter warning: context deadline exceeded Duration: 30.001881832s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [...X.X..XX........................X.X..X.X....X....X........] duration: 26.894188721s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:19:52 UTC) orbiter warning: context deadline exceeded Duration: 26.8942138s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...................X..............] duration: 9.857884849s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:19:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 9.857907171s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...................X.............] duration: 30.000587503s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:19:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 30.000612141s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XXXXX] duration: 30.001374439s trace: https://jaeger.dev.storj.io/trace/6c26ec1698e2885b FAIL (2026-01-13 14:19:07 UTC) orbiter warning: context deadline exceeded Duration: 30.00139577s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000701034s trace: https://jaeger.dev.storj.io/trace/2d556585ce20f4e5 FAIL (2026-01-13 14:19:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000772259s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [....X.X..XX........................X.X..X.X....X....X.......] duration: 20.970200854s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:18:48 UTC) orbiter warning: context deadline exceeded Duration: 20.970216744s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XXXX] duration: 30.000900133s trace: https://jaeger.dev.storj.io/trace/3966b3de60e8e67e FAIL (2026-01-13 14:18:34 UTC) orbiter warning: context deadline exceeded Duration: 30.000922976s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.....X.X..XX........................X.X..X.X....X....X......] duration: 35.746471256s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:18:27 UTC) orbiter warning: context deadline exceeded Duration: 35.746490131s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.797810536s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:18:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.797836586s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [X..........................X...................X............] duration: 8.92059711s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:18:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 8.920642707s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.984903897s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:18:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.98493127s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000945268s trace: https://jaeger.dev.storj.io/trace/255bd41c1d7d67f0 FAIL (2026-01-13 14:18:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000966048s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XXX] duration: 30.00119195s trace: https://jaeger.dev.storj.io/trace/40de131f5ece8da5 FAIL (2026-01-13 14:17:43 UTC) orbiter warning: context deadline exceeded Duration: 30.001210194s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000535227s trace: https://jaeger.dev.storj.io/trace/336ff2b2754b06db FAIL (2026-01-13 14:17:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000556928s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X..........................X...................X...........] duration: 18.142266656s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:17:19 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 18.142293687s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [......X.X..XX........................X.X..X.X....X....X.....] duration: 33.412260789s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:17:14 UTC) orbiter warning: context deadline exceeded Duration: 33.412281438s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.681450697s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:17:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.68147367s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 50 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...XX] duration: 30.001505303s trace: https://jaeger.dev.storj.io/trace/4f358775bd99e4e6 FAIL (2026-01-13 14:17:09 UTC) orbiter warning: context deadline exceeded Duration: 30.00151983s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.836046316s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:16:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.83606946s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 50 out of 60 is failed (threshold=3) [X.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...X] duration: 30.0013499s trace: https://jaeger.dev.storj.io/trace/180a77aef6c5630d FAIL (2026-01-13 14:16:39 UTC) orbiter warning: context deadline exceeded Duration: 30.001372814s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X..........................X...................X..........] duration: 6.961063547s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:16:34 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.961090499s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [X......X.X..XX........................X.X..X.X....X....X....] duration: 26.001053966s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:16:22 UTC) orbiter warning: context deadline exceeded Duration: 26.001087368s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001647828s trace: https://jaeger.dev.storj.io/trace/45d291bd8dcde58a FAIL (2026-01-13 14:16:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001668027s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X..........................X...................X.........] duration: 18.351653603s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:16:07 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 18.351672029s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 50 out of 60 is failed (threshold=3) [XX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX...] duration: 30.000639337s trace: https://jaeger.dev.storj.io/trace/45b8923772088c52 FAIL (2026-01-13 14:16:01 UTC) orbiter warning: context deadline exceeded Duration: 30.000716654s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.717510033s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:15:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.717534728s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X..........................X...................X........] duration: 8.23926126s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:15:25 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 8.239426705s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000675561s trace: https://jaeger.dev.storj.io/trace/97dcb7ca694fa3 FAIL (2026-01-13 14:15:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000702833s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.80762393s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:15:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.80765565s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.X......X.X..XX........................X.X..X.X....X....X...] duration: 26.3524187s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:15:14 UTC) orbiter warning: context deadline exceeded Duration: 26.352575969s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X..........................X...................X.......] duration: 11.831993151s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:15:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 11.83202497s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.XXXX..] duration: 28.157585371s trace: https://jaeger.dev.storj.io/trace/45b8923772088c52 FAIL (2026-01-13 14:15:00 UTC) orbiter warning: context deadline exceeded Duration: 28.15761196s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X..........................X...................X......] duration: 13.853804186s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:14:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 13.853918604s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001352304s trace: https://jaeger.dev.storj.io/trace/618af04acde72621 FAIL (2026-01-13 14:14:53 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001374917s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.673360992s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:14:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.673385259s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X..........................X...................X.....] duration: 11.576142771s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:14:14 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 11.576171265s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [..X......X.X..XX........................X.X..X.X....X....X..] duration: 20.10933841s trace: https://jaeger.dev.storj.io/trace/6488264266372d6 FAIL (2026-01-13 14:13:56 UTC) orbiter warning: context deadline exceeded Duration: 20.109362928s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)