Orbiter History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.028452437s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:09:43 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.028476462s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001494968s trace: https://jaeger.dev.storj.io/trace/59ea23bc9fae5492 FAIL (2025-12-09 10:09:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00152197s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [............X...X..............X........X......X............] duration: 5.912751004s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:09:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.912779759s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X...................................X.................] duration: 1.946326013s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:08:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.946355301s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 683.162121ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:08:30 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 683.191758ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X...................................X................] duration: 2.019209514s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:08:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.019240553s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.............X...X..............X........X......X...........] duration: 5.882576737s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:08:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.882605141s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X...................................X...............] duration: 1.901170973s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:07:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.901201642s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 686.656306ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:07:36 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 686.693677ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...................................X..............] duration: 1.904840386s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:07:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.904867247s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..............X...X..............X........X......X..........] duration: 5.592588799s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:07:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.592618687s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [...............X...X..............X........X......X.........] duration: 5.940413672s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:06:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.940445613s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 677.109505ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:06:49 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 677.158148ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...................................X.............] duration: 1.979420295s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:06:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.979447465s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 12.353978575s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:06:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 12.354004515s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 686.545284ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:06:17 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 686.572496ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...................................X............] duration: 1.983806499s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:05:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.983834734s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [................X...X..............X........X......X........] duration: 5.993874239s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:05:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.993903664s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 678.086506ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:05:26 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 678.105864ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 10.528472803s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:05:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 10.528501408s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...................................X...........] duration: 2.053933062s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:05:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.054087186s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.................X...X..............X........X......X.......] duration: 5.69407237s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:04:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.694102337s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 4.612164009s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:04:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.612181943s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.992721531s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:04:14 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.992751768s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...................................X..........] duration: 3.004992133s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:04:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 3.00502643s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...................................X.........] duration: 2.982705914s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:03:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.982739139s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 11.1311239s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:03:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 11.131153937s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..................X...X..............X........X......X......] duration: 5.838253501s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:03:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.838282576s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.132160456s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:03:11 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.132203948s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...................................X........] duration: 1.942481083s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:03:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.942513606s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X...................................X.......] duration: 2.070270251s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:02:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.070309296s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.114067172s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:02:45 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.114097861s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [...................X...X..............X........X......X.....] duration: 5.671981482s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:02:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.672032148s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 11.857949496s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:02:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 11.857977209s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X...................................X......] duration: 2.793866037s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:02:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.793898999s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X...................................X.....] duration: 3.040282975s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:02:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 3.040314377s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 9.358112233s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:01:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 9.35813173s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.12966787s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:01:47 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.12969924s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [....................X...X..............X........X......X....] duration: 5.614298912s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:01:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.61445509s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.064704177s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:01:22 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.064723062s core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 10.322767435s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:01:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 10.32279652s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X...................................X....] duration: 1.921036812s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:01:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.921072031s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.038944807s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 10:01:02 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.038977248s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.....................X...X..............X........X......X...] duration: 5.881130768s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:00:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.881158791s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [......................X...X..............X........X......X..] duration: 5.613621819s trace: https://jaeger.dev.storj.io/trace/2cdf4058286f63e8 FAIL (2025-12-09 10:00:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.613653971s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X...................................X...] duration: 2.013239402s trace: https://jaeger.dev.storj.io/trace/6cb2657ad006bedf FAIL (2025-12-09 10:00:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 09:57:44.389846478 (90h28m44.260929523s) [upload=78917]: Starting upload Dec 9 09:57:44.390051578 (90h28m44.261134613s) [upload=78917]: Done starting upload Dec 9 09:57:44.390125740 (90h28m44.261208775s) [upload=78917]: Uploading segments... Dec 9 09:57:44.390224027 (90h28m44.261307072s) [upload=78917]: Got next segment. Inline: true Dec 9 09:57:44.390230800 (90h28m44.261313835s) [upload=78917]: Waiting for error group managing segments... Dec 9 09:57:44.390312034 (90h28m44.261395069s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 09:57:44.390318787 (90h28m44.261401822s) [upload=78917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 9 09:57:44.390323356 (90h28m44.261406391s) [upload=78917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:58:21.934924620 (90h29m21.806007665s) [upload=78917]: Done uploading segments... Dec 9 09:58:21.934974756 (90h29m21.806057801s) [upload=78917]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.013266424s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 9.574922111s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 10:00:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 9.574957848s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 806.553545ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 09:59:57 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 806.577439ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 8.988061525s trace: https://jaeger.dev.storj.io/trace/2278184cf7cb09d3 FAIL (2025-12-09 09:59:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.957067453 (89h49m23.828150528s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.958192827 (89h49m23.829275862s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.963154113 (89h49m23.834237159s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.964026705 (89h49m23.83510977s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.967189518 (89h49m23.838272563s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969161493 (89h49m23.840244548s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.969242788 (89h49m23.840325834s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.970553794 (89h49m23.841636849s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.972813026 (89h49m23.843896081s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:23.978089925 (89h49m23.84917298s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Uploading piece... Dec 9 09:18:24.785720741 (89h49m24.656803786s) [upload=78358]: Next returned nil segment Dec 9 09:18:24.785736831 (89h49m24.656819876s) [upload=78358]: Waiting for error group managing segments... Dec 9 09:18:25.168467403 (89h49m25.039550448s) [noise=true , address=185.167.204.206:4049 , piece_id=MEZGGAN2ZFVW535D3QU5FIF5X2XNI67T7FMNIJQMMXLHF5NN7KCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185302831 (89h49m25.056385876s) [noise=true , address=185.167.204.206:4054 , piece_id=CBV3DDAZUBWN4RVNVA37BC5ESANQPT4MYGHWMNTO4AZJ32ZZ7LWQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.185793916 (89h49m25.056876961s) [noise=true , address=185.167.204.206:4057 , piece_id=AVPMO43TLI7KCC52Y4OH2W2G3RLMGLBU7BTGPEO5FG2VUN7272DA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.186032270 (89h49m25.057115315s) [noise=true , address=185.167.204.206:4050 , piece_id=LBHTVVRMFZERIJPYLJGIZB6FC4YERLQI4YL2OMUXKN37OLQHDHDA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.188698217 (89h49m25.059781262s) [noise=true , address=185.167.204.205:4016 , piece_id=T4SMB72E6JS76626B3SOUTKCFK6OHRPEQSKOLCBBQW5XY5PO3TNA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.198062969 (89h49m25.069146014s) [noise=true , address=185.167.204.205:4024 , piece_id=Q53WJVADCT7IWGNY7OUXAA4VGI6ARFLTGDLM2KM6LBE2HBBA3DAQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.201189182 (89h49m25.072272227s) [noise=true , address=185.167.204.206:4060 , piece_id=TR5JMA65VL3X2JYKINUGVORZFKKBKV2NY2LBLHPQJS5Z4P2NJHWA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.202370381 (89h49m25.073453426s) [noise=true , address=185.167.204.206:4069 , piece_id=LD44HDOWUF7N2LWP3MU4DSDXO3YAI6KVCUP2US3A6OX6WIGW3XYQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.205089780 (89h49m25.076172816s) [noise=true , address=185.167.204.205:4032 , piece_id=R75QHC7MZRLI6HXHLCBWU5ZCKUQQI35I6URWVG7WKDIAFWIPN7XQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.207830660 (89h49m25.078913705s) [noise=true , address=185.167.204.206:4037 , piece_id=NW4QWZFM7JA6UF7JNUWNPEYL76BLWLB5KF3VLHGJZSCORTKL5SOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.208925113 (89h49m25.080008159s) [noise=true , address=185.167.204.205:4036 , piece_id=JE2RTZWLPINK4DZEIN5VZSF7NQNDIJ4EEEHLNXIGCXZAVVK23RGQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.209472386 (89h49m25.080555431s) [noise=true , address=185.167.204.206:4065 , piece_id=LQIMSCI7CLY57EOLIERM5NSR64QSNR64FD6H2L6OUQV6VANBP77Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.211577764 (89h49m25.082660809s) [noise=true , address=185.167.204.205:4017 , piece_id=MILTVCWHWQJBMZFZPFXXCDSTPWRYHDHBFQEOPO6YG5PQTMD3RONQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.219514148 (89h49m25.090597183s) [noise=true , address=185.167.204.205:4015 , piece_id=YU77JIVCOQ37G52QR4RKZTQ2WY7ME4JPHBM7RTUHBHAM5A4DCFDQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.769337000 (89h49m25.640420045s) [noise=true , address=81.171.14.70:4039 , piece_id=QFA6JIAMTETMRGCCK6PJDUKWH43PZJOQQ4X5Y5ILCGL5R37OYTUQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.772473423 (89h49m25.643556468s) [noise=true , address=81.171.14.70:4032 , piece_id=FJAX2O76ZV2L5FWWXABF7FGT5JUQ6A3YDMKJUQSREBEJPIGQP7RA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800364573 (89h49m25.671447608s) [noise=true , address=81.171.14.70:4030 , piece_id=6VDC74RCXTDZDGRMAGDR6HKRMEZAUCVM2KXIORPRFHOUPZ4SRURQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.800677198 (89h49m25.671760243s) [noise=true , address=81.171.14.70:4047 , piece_id=WZJLBCHCHZHOHL5IC66ZWGIF4EOHNOEH3XBVBXIZCV65YRSTNPBA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.810545961 (89h49m25.681629006s) [noise=true , address=81.171.14.70:4046 , piece_id=CZRVAU2PNZBUSVCYX5MOV72SZXID4GPJ7BDPPD4NIJ235EY62YMA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:25.838216351 (89h49m25.709299396s) [noise=true , address=81.171.14.70:4031 , piece_id=TL65276T2XDWZUTNUZ7IBI5D4BSAMB5S6W6G5CT3NZ6JF2WSESOA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.250350354 (89h49m26.121433399s) [noise=true , address=81.171.14.70:4036 , piece_id=3PRKMFHXBCM52IQ3IUGSQR5G727WYKUTVJBVC5QERPZ2WFCGSA3Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.277784646 (89h49m26.148867691s) [noise=true , address=81.171.14.70:4048 , piece_id=PTOL6CIPLQS6LTCCLI6PFEXOAOXHTMUQ4SYTRRJRWSXTED4VHMFQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.519380506 (89h49m26.390463552s) [noise=true , address=89.149.201.147:4005 , piece_id=HVHGMPYGLWAMDJVZTNUVXZ3GCPWDKDF3SBCJO2ILKKQGSPAYEBFA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.910352793 (89h49m26.781435828s) [noise=true , address=89.149.201.147:4001 , piece_id=PJ3CG6DO2HMSDREM23CEEBEDEEMREOBD2C2WMZSM2B5MSRASY6GQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.962433886 (89h49m26.833516921s) [noise=true , address=89.149.201.147:4004 , piece_id=JNEKFVLJN5FTXT46CVFQVGOA5BTDNL6TDB655V6WWMZWT5LC7FBQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974479733 (89h49m26.845562768s) [noise=true , address=89.149.201.147:4023 , piece_id=LQPBNSGESUY2CONNWGJWPE67S76QATD3T2DICJPYJ3H4J2NRCWKQ, seg_pos={0 0}, upload=78358]: Done uploading piece. err: <nil> Dec 9 09:18:26.974507296 (89h49m26.845590341s) [seg_pos={0 0}, upload=78358]: Segment reached optimal threshold of 26 pieces. Dec 9 09:18:26.974751972 (89h49m26.845835017s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974762383 (89h49m26.845845438s) [noise=true , address=89.149.201.147:4007 , piece_id=PY2KA7ZSI422BIOOTFWMLFY3LVQIFS4DC2VWTBR5HUN5C36DR53Q, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974851171 (89h49m26.845934226s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 9 09:18:26.974873604 (89h49m26.845956669s) [noise=true , address=89.149.201.147:4019 , piece_id=JI735NFBOCR6YSMRDKNIH653LHV3D5LGY34PJMPISBZE7TV57MCA, seg_pos={0 0}, upload=78358]: Long tail cancellation due to optimal threshold Dec 9 09:18:26.974923419 (89h49m26.846006464s) [seg_pos={0 0}, upload=78358]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 09:18:26.975251043 (89h49m26.846334138s) [upload=78358]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 09:18:26.975262835 (89h49m26.84634587s) [upload=78358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 09:19:23.276531408 (89h50m23.147614453s) [upload=78358]: Done uploading segments... Dec 9 09:19:23.276661235 (89h50m23.14774428s) [upload=78358]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.988093366s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.119052868s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/754b20513c76ffd8 FAIL (2025-12-09 09:59:40 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.119081272s core satellite us1

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)