Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001937663s trace: https://jaeger.dev.storj.io/trace/3269d9835b97d912 FAIL (2026-01-13 14:10:10 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001963773s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.X] duration: 30.001172197s trace: https://jaeger.dev.storj.io/trace/78bbe919c5dd07f7 FAIL (2026-01-13 14:10:09 UTC) orbiter warning: context deadline exceeded Duration: 30.001230458s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.703064178s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:10:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.703094236s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001217866s trace: https://jaeger.dev.storj.io/trace/14e3b96080d2641d FAIL (2026-01-13 14:09:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001260797s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.X.....X......X.X..XX........................X.X..X.X....X..] duration: 19.891217045s trace: https://jaeger.dev.storj.io/trace/37c9196dbf12e31b FAIL (2026-01-13 14:09:41 UTC) orbiter warning: context deadline exceeded Duration: 19.891231402s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X..........................X...................X] duration: 10.624515267s trace: https://jaeger.dev.storj.io/trace/77716bb606360f1 FAIL (2026-01-13 14:09:35 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.624544813s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.770173534s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:09:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.770200525s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [..X.....X......X.X..XX........................X.X..X.X....X.] duration: 24.747145334s trace: https://jaeger.dev.storj.io/trace/37c9196dbf12e31b FAIL (2026-01-13 14:09:21 UTC) orbiter warning: context deadline exceeded Duration: 24.747160492s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X.] duration: 26.77922122s trace: https://jaeger.dev.storj.io/trace/4616f719879a6463 FAIL (2026-01-13 14:09:19 UTC) orbiter warning: context deadline exceeded Duration: 26.77926303s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X..........................X...................] duration: 12.212182037s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:09:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 12.212208236s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.796956466s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:08:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.796983277s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [...X.....X......X.X..XX........................X.X..X.X....X] duration: 1m0.000934805s trace: https://jaeger.dev.storj.io/trace/37c9196dbf12e31b FAIL (2026-01-13 14:08:56 UTC) orbiter warning: context deadline exceeded Duration: 1m0.000953601s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001309376s trace: https://jaeger.dev.storj.io/trace/6c142a617f60e2b1 FAIL (2026-01-13 14:08:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00133273s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X..........................X..................] duration: 12.409328759s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:08:51 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 12.409348888s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 52 out of 60 is failed (threshold=3) [XXXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..X] duration: 30.00104404s trace: https://jaeger.dev.storj.io/trace/4616f719879a6463 FAIL (2026-01-13 14:08:26 UTC) orbiter warning: context deadline exceeded Duration: 30.001067976s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X..........................X.................] duration: 14.275175297s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:08:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 14.275279344s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.893663968s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:08:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.893690909s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000826799s trace: https://jaeger.dev.storj.io/trace/3a3939a15617681e FAIL (2026-01-13 14:07:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000849873s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.875104292s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:07:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.875133957s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001407415s trace: https://jaeger.dev.storj.io/trace/2ae7d00ba1f8db8 FAIL (2026-01-13 14:07:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00143583s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...............X..........................X................] duration: 5.777078131s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:07:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 5.777107187s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 52 out of 60 is failed (threshold=3) [XXXXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX..] duration: 29.709255067s trace: https://jaeger.dev.storj.io/trace/217b7c233672e7d4 FAIL (2026-01-13 14:07:14 UTC) orbiter warning: context deadline exceeded Duration: 29.709274384s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.781326824s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:07:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.781459948s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [....X.....X......X.X..XX........................X.X..X.X....] duration: 23.071588674s trace: https://jaeger.dev.storj.io/trace/2b4e105d3177de5 FAIL (2026-01-13 14:07:06 UTC) orbiter warning: context deadline exceeded Duration: 23.071615256s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X...............X..........................X...............] duration: 11.292520081s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:06:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 11.292543495s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.779030785s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:06:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.779045524s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 52 out of 60 is failed (threshold=3) [.XXXXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX.] duration: 24.503638575s trace: https://jaeger.dev.storj.io/trace/217b7c233672e7d4 FAIL (2026-01-13 14:06:22 UTC) orbiter warning: context deadline exceeded Duration: 24.503661037s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001497836s trace: https://jaeger.dev.storj.io/trace/38e5fe37959fa8e5 FAIL (2026-01-13 14:06:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001519929s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X...............X..........................X..............] duration: 14.420589596s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:06:06 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 14.420604435s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.....X.....X......X.X..XX........................X.X..X.X...] duration: 20.015578863s trace: https://jaeger.dev.storj.io/trace/2b4e105d3177de5 FAIL (2026-01-13 14:06:05 UTC) orbiter warning: context deadline exceeded Duration: 20.015615473s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001532464s trace: https://jaeger.dev.storj.io/trace/718697a10f6398aa FAIL (2026-01-13 14:05:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001553363s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [......X.....X......X.X..XX........................X.X..X.X..] duration: 26.754254241s trace: https://jaeger.dev.storj.io/trace/2b4e105d3177de5 FAIL (2026-01-13 14:05:45 UTC) orbiter warning: context deadline exceeded Duration: 26.754269632s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X...............X..........................X.............] duration: 12.065464135s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:05:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 12.06549307s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 53 out of 60 is failed (threshold=3) [X.XXXXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXXX] duration: 30.000884515s trace: https://jaeger.dev.storj.io/trace/217b7c233672e7d4 FAIL (2026-01-13 14:05:39 UTC) orbiter warning: context deadline exceeded Duration: 30.000910165s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000917964s trace: https://jaeger.dev.storj.io/trace/2e49289fe1588349 FAIL (2026-01-13 14:05:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000932964s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.820211421s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:05:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.820233633s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.......X.....X......X.X..XX........................X.X..X.X.] duration: 42.184801594s trace: https://jaeger.dev.storj.io/trace/2b4e105d3177de5 FAIL (2026-01-13 14:05:18 UTC) orbiter warning: context deadline exceeded Duration: 42.184818535s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001200184s trace: https://jaeger.dev.storj.io/trace/622f6f66917cdf38 FAIL (2026-01-13 14:05:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001229831s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 53 out of 60 is failed (threshold=3) [XX.XXXXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XXX] duration: 30.001399563s trace: https://jaeger.dev.storj.io/trace/488bfd8a6e8255f4 FAIL (2026-01-13 14:05:01 UTC) orbiter warning: context deadline exceeded Duration: 30.001418431s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X...............X..........................X............] duration: 17.934599584s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:05:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 17.934620764s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [X.......X.....X......X.X..XX........................X.X..X.X] duration: 1m0.00103314s trace: https://jaeger.dev.storj.io/trace/2b4e105d3177de5 FAIL (2026-01-13 14:04:35 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001058437s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.846369106s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:04:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.846394694s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.00202553s trace: https://jaeger.dev.storj.io/trace/2ea3b8267b7590bb FAIL (2026-01-13 14:04:31 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.002049606s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 52 out of 60 is failed (threshold=3) [.XX.XXXXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.XX] duration: 10.826710932s trace: https://jaeger.dev.storj.io/trace/576e29d241e0c70c FAIL (2026-01-13 14:04:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.826807145s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X...............X..........................X...........] duration: 14.451031744s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:04:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 14.451059628s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000710335s trace: https://jaeger.dev.storj.io/trace/67d7226436fbecb1 FAIL (2026-01-13 14:04:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000735772s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.639208341s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:03:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 5.63923358s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 52 out of 60 is failed (threshold=3) [X.XX.XXXXX.X.XXX.XXXXXXXXXXXXXX.XXXXXXXXXXX.XXXXXXXXXXXXXX.X] duration: 30.000889369s trace: https://jaeger.dev.storj.io/trace/52f38d640d4d240f FAIL (2026-01-13 14:03:30 UTC) orbiter warning: context deadline exceeded Duration: 30.000916561s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.982760264s trace: https://jaeger.dev.storj.io/trace/73be05cf653d4afe FAIL (2026-01-13 14:03:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 13 13:36:24.117263206 (934h7m23.988346251s) [upload=817610]: Starting upload Jan 13 13:36:24.117338910 (934h7m23.988421945s) [upload=817610]: Done starting upload Jan 13 13:36:24.117494386 (934h7m23.988577421s) [upload=817610]: Uploading segments... Jan 13 13:36:24.117628502 (934h7m23.988711547s) [upload=817610]: Got next segment. Inline: false Jan 13 13:36:24.117664721 (934h7m23.988747756s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 13:36:24.117669880 (934h7m23.988752926s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 13:36:24.371209731 (934h7m24.242292776s) [seg_pos={0 0}, upload=817610]: Begin upload segment... Jan 13 13:36:24.371259556 (934h7m24.242342591s) [seg_pos={0 0}, upload=817610]: Done begin upload segment. Jan 13 13:36:24.371281648 (934h7m24.242364683s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371333797 (934h7m24.242416843s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371415182 (934h7m24.242498217s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.371869277 (934h7m24.242952312s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372199797 (934h7m24.243282832s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.372727892 (934h7m24.243810937s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373139135 (934h7m24.24422218s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.373541230 (934h7m24.244624275s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374035622 (934h7m24.245118657s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374219321 (934h7m24.245302356s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374418020 (934h7m24.245501055s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374595628 (934h7m24.245678663s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.374997924 (934h7m24.246080959s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375343182 (934h7m24.246426227s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.375651398 (934h7m24.246734433s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:24.376092137 (934h7m24.247175173s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Uploading piece... Jan 13 13:36:26.018564488 (934h7m25.889647523s) [upload=817610]: Next returned nil segment Jan 13 13:36:26.018586220 (934h7m25.889669255s) [upload=817610]: Waiting for error group managing segments... Jan 13 13:36:26.342432269 (934h7m26.213515314s) [noise=true , address=77.90.31.10:4520 , piece_id=AAXHBGCAVJQAAZGUZAEQGPOXG2W7YJDN3U7AGROBF2IJJ37QFIJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.347889420 (934h7m26.218972455s) [noise=true , address=145.79.227.19:4079 , piece_id=5FTBICE4C3WDP4J44TYZTJKRYSGCSBCKNGY5OWSE6ONCFUS3QEGA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.350559393 (934h7m26.221642438s) [noise=true , address=145.79.227.6:4259 , piece_id=BMQEI6XKPECQVJB2ST5Y2SSRKDNQLSLCRZIILQBCTUXYHGJ2DDJQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.352523855 (934h7m26.2236069s) [noise=true , address=77.90.31.17:4770 , piece_id=3VGUYHVYNIW4RPLXQBOBN24KLW4AGQBIMLBBZLPJNERJQWPUSEVQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.354463117 (934h7m26.225546162s) [noise=true , address=145.79.227.17:4972 , piece_id=XCZJEQ2PUTNM2OHSDSCY4ALT6DN6FZT6WEQYU4DXNAGDGGTFMI7A, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.358481939 (934h7m26.229564974s) [noise=true , address=145.79.227.51:4409 , piece_id=VYI2KHTNW3XGPHBOQOWDGWAUEZCIJ35UWQOTVAA2TA3FBYLN5YVA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.372646239 (934h7m26.243729284s) [noise=true , address=145.79.227.5:4223 , piece_id=UQWHPIEU6BYHOKITVZQSDYGQCTUOWPWF3QX4QBQEDS57Q4KOTAZA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376231575 (934h7m26.24731461s) [noise=true , address=145.79.227.34:4906 , piece_id=NMREUZ4OHEGAHNZB4OCOM2FMMPHRIC74MNABE4AES675QSAOJIIQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.376842439 (934h7m26.247925474s) [noise=true , address=145.79.227.7:4293 , piece_id=4WVRBPIBES7YVFNQ6ULVKYSG4IW25ZZP6AGDXPEPDIY2I3VXTGAQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.428742511 (934h7m26.299825556s) [noise=true , address=145.79.227.15:4873 , piece_id=3FNZYSZ6BDNFQNVJNHTHWVP44O2ESBLKOMQ7PP3DNVS5PSTJL5TA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445372245 (934h7m26.31645528s) [noise=true , address=145.79.227.11:4729 , piece_id=IXM7XVA7FXMY5TBBJGWQ7PAIM6ROMZA2CDUP7HZSWZ62LVUMU4ZQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.445653812 (934h7m26.316736847s) [noise=true , address=145.79.227.9:4365 , piece_id=YAWJLJJI5IG2H4E6NRU4S6BBQOSJEB3P6KI4TXVYRUYKY7M3EVXA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447700218 (934h7m26.318783263s) [noise=true , address=145.79.227.45:4230 , piece_id=QSDB2OTSKZPDSUQNK6WZWWUVTSE5PVIID6SRTODUQMB3MZPZCIAA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: <nil> Jan 13 13:36:26.447724354 (934h7m26.318807389s) [seg_pos={0 0}, upload=817610]: Segment reached optimal threshold of 13 pieces. Jan 13 13:36:26.447941457 (934h7m26.319024502s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.447950133 (934h7m26.319033168s) [noise=true , address=45.91.116.10:4083 , piece_id=GV46SFSTWZSG74X4LV7LQB7SF4DLMYXIUUEDH4UF7QDM47XBAWOA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448292315 (934h7m26.31937535s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448301673 (934h7m26.319384718s) [noise=true , address=145.79.227.14:4839 , piece_id=LQI2WE6FPD7SCFMSJIMJFLIMWDPMVTEOPLXW44JVZ3EQV4YGM5PQ, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448460666 (934h7m26.319543701s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF Jan 13 13:36:26.448470184 (934h7m26.319553229s) [noise=true , address=145.79.227.20:4437 , piece_id=WXVSQBIVVFU5SQWSCDO4OJJGK3Q6LKQF5IVLHEGQM4IC3QHMRFQA, seg_pos={0 0}, upload=817610]: Long tail cancellation due to optimal threshold Jan 13 13:36:26.448489210 (934h7m26.319572255s) [seg_pos={0 0}, upload=817610]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 13:36:26.448563001 (934h7m26.319646036s) [upload=817610]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 13:36:26.448569994 (934h7m26.319653029s) [upload=817610]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 13:36:26.746862487 (934h7m26.617945522s) [upload=817610]: Done uploading segments... Jan 13 13:36:26.746980922 (934h7m26.618063968s) [upload=817610]: Upload finished. err: <nil> Duration: 6.9827899s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X...............X..........................X..........] duration: 10.694784185s trace: https://jaeger.dev.storj.io/trace/fdfe182bf204f7d FAIL (2026-01-13 14:03:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.694811897s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)