Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [X.................................X.........X...............] duration: 5.959804616s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:47:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.959822239s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.877511635s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:47:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.87754101s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 706.140264ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:47:16 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 706.166513ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X..............X....X..........................] duration: 5.637880055s trace: https://jaeger.dev.storj.io/trace/438983f8dd4dc52 FAIL (2025-12-08 05:46:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.637906936s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 689.749942ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:46:40 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 689.776914ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...X........................X...............................] duration: 3.567066786s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:46:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.567093649s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.70896117s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:46:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.708992039s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.058841285s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:46:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.058859108s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.X.................................X.........X..............] duration: 5.660679719s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:46:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.66070675s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X..............X....X.........................] duration: 5.907317161s trace: https://jaeger.dev.storj.io/trace/438983f8dd4dc52 FAIL (2025-12-08 05:46:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.907349634s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....X........................X..............................] duration: 3.539840994s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:46:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.539871041s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..X.................................X.........X.............] duration: 5.608825291s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:45:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.608860869s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.887767209s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:45:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.887796024s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 726.291418ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:45:30 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 726.31371ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X..............X....X........................] duration: 5.762319772s trace: https://jaeger.dev.storj.io/trace/438983f8dd4dc52 FAIL (2025-12-08 05:45:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.762347995s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 4.949800304s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:45:18 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.949821894s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X..............X....X.......................] duration: 5.847598196s trace: https://jaeger.dev.storj.io/trace/438983f8dd4dc52 FAIL (2025-12-08 05:45:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.847631919s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....X........................X.............................] duration: 3.444062557s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:45:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.444092724s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.082485775s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:45:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.082520812s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 686.871741ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:45:02 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 686.891679ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [X..X.................................X.........X............] duration: 5.577159683s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:44:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.577190593s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......X........................X............................] duration: 3.457984936s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:44:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.458010385s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 695.740761ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:44:34 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 695.763143ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.76830335s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:44:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.768333169s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.X..X.................................X.........X...........] duration: 5.773518592s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:44:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.77353888s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......X........................X...........................] duration: 3.550243343s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:44:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.550269883s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X..............X....X......................] duration: 5.923824078s trace: https://jaeger.dev.storj.io/trace/438983f8dd4dc52 FAIL (2025-12-08 05:44:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.924017236s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.684434894s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:43:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.684463791s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........X........................X..........................] duration: 3.432394809s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:43:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.432425767s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 4.978321085s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:43:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.978347575s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..X..X.................................X.........X..........] duration: 5.507047005s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:43:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.507071962s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 705.038696ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:43:21 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 705.07793ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.90334067s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:43:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.903379085s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........X........................X.........................] duration: 3.483566992s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:43:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.483588434s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.801298607s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:43:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.801329826s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X..............X....X.....................] duration: 5.958420092s trace: https://jaeger.dev.storj.io/trace/438983f8dd4dc52 FAIL (2025-12-08 05:43:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.958454856s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 701.39627ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:43:04 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 701.415207ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...X..X.................................X.........X.........] duration: 5.656716874s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:42:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.656757171s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.8016209s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:42:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.801652773s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 695.755498ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:42:31 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 695.783342ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.044470248s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:42:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.044513902s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........X........................X........................] duration: 3.378425214s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:42:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.378454951s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.199238163s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:42:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.199268451s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X..............X....X....................] duration: 5.663087515s trace: https://jaeger.dev.storj.io/trace/438983f8dd4dc52 FAIL (2025-12-08 05:41:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.663117351s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 695.499862ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/77386bc45618ed77 FAIL (2025-12-08 05:41:49 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 695.529078ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.710856297s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:41:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.710881694s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [X...X..X.................................X.........X........] duration: 5.785544696s trace: https://jaeger.dev.storj.io/trace/419496738746dd47 FAIL (2025-12-08 05:41:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.785575704s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.011015461s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:41:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.011044707s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.706380613s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:41:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.706406444s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.886232692s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:41:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.886274911s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)