Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [XXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXXXXXXXX.] duration: 3.423131819s trace: https://jaeger.dev.storj.io/trace/4585308a7d4003fa FAIL (2026-01-16 17:43:57 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.42315884s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......XXX...........X.......................................] duration: 16.086241043s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:43:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 16.086270049s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....XX..........................................X..........] duration: 16.326203495s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:43:34 UTC) orbiter warning: context deadline exceeded Duration: 16.326241137s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXXXXXXXX] duration: 5.001540614s trace: https://jaeger.dev.storj.io/trace/4585308a7d4003fa FAIL (2026-01-16 17:43:28 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00156505s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......XX..........................................X.........] duration: 15.802546463s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:43:05 UTC) orbiter warning: context deadline exceeded Duration: 15.802568805s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......XXX...........X......................................] duration: 21.15866885s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:42:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 21.158720428s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXXXXXXX] duration: 5.001589135s trace: https://jaeger.dev.storj.io/trace/39fe9ad8e5ea524a FAIL (2026-01-16 17:42:37 UTC) orbiter warning: context deadline exceeded Duration: 5.001616788s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......XX..........................................X........] duration: 7.605757733s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:42:35 UTC) orbiter warning: context deadline exceeded Duration: 7.60584012s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........XX..........................................X.......] duration: 16.833957527s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:41:59 UTC) orbiter warning: context deadline exceeded Duration: 16.834000378s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXXXXXX] duration: 5.000949695s trace: https://jaeger.dev.storj.io/trace/640b8d04f40db8eb FAIL (2026-01-16 17:41:56 UTC) orbiter warning: context deadline exceeded Duration: 5.000972761s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........XXX...........X.....................................] duration: 23.670833894s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:41:40 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 23.670866035s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........XX..........................................X......] duration: 12.679438778s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:41:38 UTC) orbiter warning: context deadline exceeded Duration: 12.679464257s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXXXXX] duration: 5.001747178s trace: https://jaeger.dev.storj.io/trace/372fc61a19e08a2d FAIL (2026-01-16 17:41:33 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001771292s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........XXX...........X....................................] duration: 16.123594693s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:41:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 16.123619429s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........XXX...........X...................................] duration: 21.98450932s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:40:42 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 21.984538608s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........XX..........................................X.....] duration: 15.584438854s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:40:33 UTC) orbiter warning: context deadline exceeded Duration: 15.584469201s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.784733342s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:40:29 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.78476457s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXXXX] duration: 5.001497087s trace: https://jaeger.dev.storj.io/trace/7186fbfdb41c5b2e FAIL (2026-01-16 17:40:23 UTC) orbiter warning: context deadline exceeded Duration: 5.001520009s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........XXX...........X..................................] duration: 16.695992733s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:40:05 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 16.69601803s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........XX..........................................X....] duration: 18.237297319s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:40:01 UTC) orbiter warning: context deadline exceeded Duration: 18.237431103s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXXX] duration: 5.000904401s trace: https://jaeger.dev.storj.io/trace/cd916dd1eb7c23f FAIL (2026-01-16 17:40:00 UTC) orbiter warning: context deadline exceeded Duration: 5.000928225s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............XXX...........X.................................] duration: 21.559182176s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:39:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 21.559210491s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............XX..........................................X...] duration: 14.781803294s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:39:18 UTC) orbiter warning: context deadline exceeded Duration: 14.781837018s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 5.788441884s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:39:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.788468454s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXXX] duration: 5.001112679s trace: https://jaeger.dev.storj.io/trace/34bdb3eeb27e1487 FAIL (2026-01-16 17:39:07 UTC) orbiter warning: context deadline exceeded Duration: 5.001138128s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXXX] duration: 5.001186668s trace: https://jaeger.dev.storj.io/trace/56804f1ff725dfff FAIL (2026-01-16 17:38:47 UTC) orbiter warning: context deadline exceeded Duration: 5.001210674s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............XX..........................................X..] duration: 15.767062773s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:38:42 UTC) orbiter warning: context deadline exceeded Duration: 15.767090687s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 5.691532395s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:38:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.691560337s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............XXX...........X................................] duration: 14.995411792s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:38:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 14.99543233s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............XXX...........X...............................] duration: 27.932555634s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:37:58 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 27.932602273s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............XX..........................................X.] duration: 20.06379172s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:37:48 UTC) orbiter warning: context deadline exceeded Duration: 20.063819553s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXXX] duration: 5.00179682s trace: https://jaeger.dev.storj.io/trace/2da27479bc3f9009 FAIL (2026-01-16 17:37:46 UTC) orbiter warning: context deadline exceeded Duration: 5.001819743s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 5.761389844s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:37:26 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.761421123s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............XX..........................................X] duration: 1m0.001296778s trace: https://jaeger.dev.storj.io/trace/514c26b22349e72f FAIL (2026-01-16 17:37:17 UTC) orbiter warning: context deadline exceeded Duration: 1m0.00131861s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXXX] duration: 5.001248767s trace: https://jaeger.dev.storj.io/trace/6c532a266d2d17ae FAIL (2026-01-16 17:37:16 UTC) orbiter warning: context deadline exceeded Duration: 5.001268113s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............XXX...........X..............................] duration: 21.905121064s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:36:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 21.905143326s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [.XXXXXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXXX] duration: 5.001436883s trace: https://jaeger.dev.storj.io/trace/68027ff17872eefd FAIL (2026-01-16 17:36:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001457422s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 5.806762875s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:36:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.806794647s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [................XXX...........X.............................] duration: 14.607638996s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:36:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 14.607656058s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 20.603778151s trace: https://jaeger.dev.storj.io/trace/70c2b0731de5fb9c FAIL (2026-01-16 17:36:07 UTC) orbiter warning: context deadline exceeded Duration: 20.603793129s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................XXX...........X............................] duration: 28.82123989s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:35:58 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 28.821261541s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 5.834716652s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:35:49 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.834755005s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 5.715419378s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:35:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.715447681s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [X.XXXXXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXXX] duration: 5.001279928s trace: https://jaeger.dev.storj.io/trace/520068967b4cffda FAIL (2026-01-16 17:35:11 UTC) orbiter warning: context deadline exceeded Duration: 5.001302942s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 17.545617742s trace: https://jaeger.dev.storj.io/trace/70c2b0731de5fb9c FAIL (2026-01-16 17:35:05 UTC) orbiter warning: context deadline exceeded Duration: 17.54564726s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................XXX...........X...........................] duration: 17.67057991s trace: https://jaeger.dev.storj.io/trace/4a055e3bcb21e3db FAIL (2026-01-16 17:34:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 17.670611099s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [XX.XXXXXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXXX] duration: 5.001047172s trace: https://jaeger.dev.storj.io/trace/450926b52bd2f983 FAIL (2026-01-16 17:34:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.0010617s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 5.885247517s trace: https://jaeger.dev.storj.io/trace/ff1eaafc0d95989 FAIL (2026-01-16 17:34:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments... Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment... Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment. Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece... Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments... Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil> Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments... Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil> Duration: 5.885259128s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 6.419748868s trace: https://jaeger.dev.storj.io/trace/70c2b0731de5fb9c FAIL (2026-01-16 17:34:15 UTC) orbiter warning: context deadline exceeded Duration: 6.419772151s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [XXX.XXXXXXXXXXXXXX.XXXXXXXX.XXXXXXXXXXXXXXXXX.XXXXXX.XXXXXXX] duration: 5.001425242s trace: https://jaeger.dev.storj.io/trace/2232a1e793ae2bdb FAIL (2026-01-16 17:34:08 UTC) orbiter warning: context deadline exceeded Duration: 5.00145006s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)