Orbiter History

Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 870158 reports (Page 11595 of 17404)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 477.516031ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/39a3ed12475253d0 FAIL (2025-12-09 15:51:06 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 477.545269ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X....X.........................................X...] duration: 3.01377658s trace: https://jaeger.dev.storj.io/trace/241e9ffbc453b19d FAIL (2025-12-09 15:51:02 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 3.013811889s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X..X....X.......................XX..................X......] duration: 27.872814246s trace: https://jaeger.dev.storj.io/trace/7e3fae7b586d38d6 FAIL (2025-12-09 15:50:45 UTC) orbiter warning: context deadline exceeded Duration: 27.872841226s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X....X.........................................X..] duration: 4.266072162s trace: https://jaeger.dev.storj.io/trace/241e9ffbc453b19d FAIL (2025-12-09 15:50:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 4.266105837s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.876330222s trace: https://jaeger.dev.storj.io/trace/2764ea1e2faac6a FAIL (2025-12-09 15:50:36 UTC) orbiter warning: context deadline exceeded Duration: 6.876358696s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 20 out of 60 is failed (threshold=6) [XXX.XX...X......X...X.XX...X....X...X...X.X..XX...XX.X......] duration: 3.620353439s trace: https://jaeger.dev.storj.io/trace/2a2bf6f26348261f FAIL (2025-12-09 15:50:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.620442006s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 480.89667ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/39a3ed12475253d0 FAIL (2025-12-09 15:50:14 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 480.926215ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.........................................X...........X...] duration: 5.844975468s trace: https://jaeger.dev.storj.io/trace/593b271687016c4f FAIL (2025-12-09 15:50:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 15:47:50.798824866 (96h18m50.669907901s) [upload=83937]: Starting upload Dec 9 15:47:50.798921369 (96h18m50.670004404s) [upload=83937]: Done starting upload Dec 9 15:47:50.799010178 (96h18m50.670093213s) [upload=83937]: Uploading segments... Dec 9 15:47:50.799294159 (96h18m50.670377204s) [upload=83937]: Got next segment. Inline: false Dec 9 15:47:50.799363250 (96h18m50.670446295s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 15:47:50.799372037 (96h18m50.670455092s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 15:47:51.056426954 (96h18m50.92751001s) [seg_pos={0 0}, upload=83937]: Begin upload segment... Dec 9 15:47:51.056481187 (96h18m50.927564232s) [seg_pos={0 0}, upload=83937]: Done begin upload segment. Dec 9 15:47:51.056513298 (96h18m50.927596343s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.056576559 (96h18m50.927659594s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057100897 (96h18m50.928183942s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057596040 (96h18m50.928679075s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058125198 (96h18m50.929208243s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058421582 (96h18m50.929504617s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058696356 (96h18m50.929779391s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058972071 (96h18m50.930055106s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.059347686 (96h18m50.930430721s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.061182009 (96h18m50.932265044s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.062514146 (96h18m50.933597181s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.064197953 (96h18m50.935280998s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.065677489 (96h18m50.936760534s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.067090440 (96h18m50.938173485s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.068340300 (96h18m50.939423345s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.069558109 (96h18m50.940641154s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:52.703886775 (96h18m52.57496981s) [upload=83937]: Next returned nil segment Dec 9 15:47:52.703900601 (96h18m52.574983636s) [upload=83937]: Waiting for error group managing segments... Dec 9 15:47:53.070939400 (96h18m52.942022445s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.074549104 (96h18m52.945632139s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077053072 (96h18m52.948136107s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077574054 (96h18m52.948657099s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.084535460 (96h18m52.955618505s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.090700220 (96h18m52.961783265s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.091191014 (96h18m52.962274079s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094302989 (96h18m52.965386025s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094537586 (96h18m52.965620622s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.115109921 (96h18m52.986192966s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.118417168 (96h18m52.989500213s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.120155649 (96h18m52.991238684s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123155120 (96h18m52.994238155s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123168146 (96h18m52.994251181s) [seg_pos={0 0}, upload=83937]: Segment reached optimal threshold of 13 pieces. Dec 9 15:47:53.123387333 (96h18m52.994470368s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123397562 (96h18m52.994480597s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123682554 (96h18m52.994765599s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123691131 (96h18m52.994774176s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123939985 (96h18m52.99502303s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123949333 (96h18m52.995032378s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123987134 (96h18m52.99507017s) [seg_pos={0 0}, upload=83937]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 15:47:53.124075293 (96h18m52.995158338s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 15:47:53.124081745 (96h18m52.99516479s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 15:48:17.417713882 (96h19m17.288796927s) [upload=83937]: Done uploading segments... Dec 9 15:48:17.417734421 (96h19m17.288817456s) [upload=83937]: Upload finished. err: <nil> Duration: 5.845004793s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 9.717192958s trace: https://jaeger.dev.storj.io/trace/2764ea1e2faac6a FAIL (2025-12-09 15:49:59 UTC) orbiter warning: context deadline exceeded Duration: 9.71724615s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [X.X..X....X.......................XX..................X.....] duration: 28.653266908s trace: https://jaeger.dev.storj.io/trace/7e3fae7b586d38d6 FAIL (2025-12-09 15:49:54 UTC) orbiter warning: context deadline exceeded Duration: 28.653293908s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X....X.........................................X.] duration: 3.441984895s trace: https://jaeger.dev.storj.io/trace/241e9ffbc453b19d FAIL (2025-12-09 15:49:52 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 3.442010424s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 21 out of 60 is failed (threshold=6) [XXXX.XX...X......X...X.XX...X....X...X...X.X..XX...XX.X.....] duration: 4.930638136s trace: https://jaeger.dev.storj.io/trace/2a2bf6f26348261f FAIL (2025-12-09 15:49:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.930665579s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.........................................X...........X..] duration: 5.970783604s trace: https://jaeger.dev.storj.io/trace/593b271687016c4f FAIL (2025-12-09 15:49:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 15:47:50.798824866 (96h18m50.669907901s) [upload=83937]: Starting upload Dec 9 15:47:50.798921369 (96h18m50.670004404s) [upload=83937]: Done starting upload Dec 9 15:47:50.799010178 (96h18m50.670093213s) [upload=83937]: Uploading segments... Dec 9 15:47:50.799294159 (96h18m50.670377204s) [upload=83937]: Got next segment. Inline: false Dec 9 15:47:50.799363250 (96h18m50.670446295s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 15:47:50.799372037 (96h18m50.670455092s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 15:47:51.056426954 (96h18m50.92751001s) [seg_pos={0 0}, upload=83937]: Begin upload segment... Dec 9 15:47:51.056481187 (96h18m50.927564232s) [seg_pos={0 0}, upload=83937]: Done begin upload segment. Dec 9 15:47:51.056513298 (96h18m50.927596343s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.056576559 (96h18m50.927659594s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057100897 (96h18m50.928183942s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057596040 (96h18m50.928679075s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058125198 (96h18m50.929208243s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058421582 (96h18m50.929504617s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058696356 (96h18m50.929779391s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058972071 (96h18m50.930055106s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.059347686 (96h18m50.930430721s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.061182009 (96h18m50.932265044s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.062514146 (96h18m50.933597181s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.064197953 (96h18m50.935280998s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.065677489 (96h18m50.936760534s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.067090440 (96h18m50.938173485s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.068340300 (96h18m50.939423345s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.069558109 (96h18m50.940641154s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:52.703886775 (96h18m52.57496981s) [upload=83937]: Next returned nil segment Dec 9 15:47:52.703900601 (96h18m52.574983636s) [upload=83937]: Waiting for error group managing segments... Dec 9 15:47:53.070939400 (96h18m52.942022445s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.074549104 (96h18m52.945632139s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077053072 (96h18m52.948136107s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077574054 (96h18m52.948657099s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.084535460 (96h18m52.955618505s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.090700220 (96h18m52.961783265s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.091191014 (96h18m52.962274079s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094302989 (96h18m52.965386025s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094537586 (96h18m52.965620622s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.115109921 (96h18m52.986192966s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.118417168 (96h18m52.989500213s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.120155649 (96h18m52.991238684s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123155120 (96h18m52.994238155s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123168146 (96h18m52.994251181s) [seg_pos={0 0}, upload=83937]: Segment reached optimal threshold of 13 pieces. Dec 9 15:47:53.123387333 (96h18m52.994470368s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123397562 (96h18m52.994480597s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123682554 (96h18m52.994765599s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123691131 (96h18m52.994774176s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123939985 (96h18m52.99502303s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123949333 (96h18m52.995032378s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123987134 (96h18m52.99507017s) [seg_pos={0 0}, upload=83937]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 15:47:53.124075293 (96h18m52.995158338s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 15:47:53.124081745 (96h18m52.99516479s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 15:48:17.417713882 (96h19m17.288796927s) [upload=83937]: Done uploading segments... Dec 9 15:48:17.417734421 (96h19m17.288817456s) [upload=83937]: Upload finished. err: <nil> Duration: 5.970811026s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.135476222s trace: https://jaeger.dev.storj.io/trace/1a72c3cee1ba60f FAIL (2025-12-09 15:49:31 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.135510177s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 478.457464ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/39a3ed12475253d0 FAIL (2025-12-09 15:49:31 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 478.486269ms core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 21 out of 60 is failed (threshold=6) [.XXXX.XX...X......X...X.XX...X....X...X...X.X..XX...XX.X....] duration: 4.63658499s trace: https://jaeger.dev.storj.io/trace/2a2bf6f26348261f FAIL (2025-12-09 15:49:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.636619245s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 9.811777916s trace: https://jaeger.dev.storj.io/trace/2764ea1e2faac6a FAIL (2025-12-09 15:49:11 UTC) orbiter warning: context deadline exceeded Duration: 9.811798185s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X....X.........................................X] duration: 10.647482505s trace: https://jaeger.dev.storj.io/trace/241e9ffbc453b19d FAIL (2025-12-09 15:49:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.647527029s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.........................................X...........X.] duration: 5.806075765s trace: https://jaeger.dev.storj.io/trace/593b271687016c4f FAIL (2025-12-09 15:48:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 15:47:50.798824866 (96h18m50.669907901s) [upload=83937]: Starting upload Dec 9 15:47:50.798921369 (96h18m50.670004404s) [upload=83937]: Done starting upload Dec 9 15:47:50.799010178 (96h18m50.670093213s) [upload=83937]: Uploading segments... Dec 9 15:47:50.799294159 (96h18m50.670377204s) [upload=83937]: Got next segment. Inline: false Dec 9 15:47:50.799363250 (96h18m50.670446295s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 15:47:50.799372037 (96h18m50.670455092s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 15:47:51.056426954 (96h18m50.92751001s) [seg_pos={0 0}, upload=83937]: Begin upload segment... Dec 9 15:47:51.056481187 (96h18m50.927564232s) [seg_pos={0 0}, upload=83937]: Done begin upload segment. Dec 9 15:47:51.056513298 (96h18m50.927596343s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.056576559 (96h18m50.927659594s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057100897 (96h18m50.928183942s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057596040 (96h18m50.928679075s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058125198 (96h18m50.929208243s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058421582 (96h18m50.929504617s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058696356 (96h18m50.929779391s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058972071 (96h18m50.930055106s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.059347686 (96h18m50.930430721s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.061182009 (96h18m50.932265044s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.062514146 (96h18m50.933597181s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.064197953 (96h18m50.935280998s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.065677489 (96h18m50.936760534s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.067090440 (96h18m50.938173485s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.068340300 (96h18m50.939423345s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.069558109 (96h18m50.940641154s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:52.703886775 (96h18m52.57496981s) [upload=83937]: Next returned nil segment Dec 9 15:47:52.703900601 (96h18m52.574983636s) [upload=83937]: Waiting for error group managing segments... Dec 9 15:47:53.070939400 (96h18m52.942022445s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.074549104 (96h18m52.945632139s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077053072 (96h18m52.948136107s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077574054 (96h18m52.948657099s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.084535460 (96h18m52.955618505s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.090700220 (96h18m52.961783265s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.091191014 (96h18m52.962274079s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094302989 (96h18m52.965386025s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094537586 (96h18m52.965620622s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.115109921 (96h18m52.986192966s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.118417168 (96h18m52.989500213s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.120155649 (96h18m52.991238684s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123155120 (96h18m52.994238155s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123168146 (96h18m52.994251181s) [seg_pos={0 0}, upload=83937]: Segment reached optimal threshold of 13 pieces. Dec 9 15:47:53.123387333 (96h18m52.994470368s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123397562 (96h18m52.994480597s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123682554 (96h18m52.994765599s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123691131 (96h18m52.994774176s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123939985 (96h18m52.99502303s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123949333 (96h18m52.995032378s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123987134 (96h18m52.99507017s) [seg_pos={0 0}, upload=83937]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 15:47:53.124075293 (96h18m52.995158338s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 15:47:53.124081745 (96h18m52.99516479s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 15:48:17.417713882 (96h19m17.288796927s) [upload=83937]: Done uploading segments... Dec 9 15:48:17.417734421 (96h19m17.288817456s) [upload=83937]: Upload finished. err: <nil> Duration: 5.806100223s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.X.X..X....X.......................XX..................X....] duration: 9.495053401s trace: https://jaeger.dev.storj.io/trace/7e3fae7b586d38d6 FAIL (2025-12-09 15:48:56 UTC) orbiter warning: context deadline exceeded Duration: 9.495133261s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 22 out of 60 is failed (threshold=6) [X.XXXX.XX...X......X...X.XX...X....X...X...X.X..XX...XX.X...] duration: 5.000858812s trace: https://jaeger.dev.storj.io/trace/2a2bf6f26348261f FAIL (2025-12-09 15:48:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000881084s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 9.083790332s trace: https://jaeger.dev.storj.io/trace/2764ea1e2faac6a FAIL (2025-12-09 15:48:46 UTC) orbiter warning: context deadline exceeded Duration: 9.083825569s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 4.92866141s trace: https://jaeger.dev.storj.io/trace/1a72c3cee1ba60f FAIL (2025-12-09 15:48:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.92869241s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 468.939509ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/39a3ed12475253d0 FAIL (2025-12-09 15:48:38 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 468.970869ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X....X.........................................] duration: 5.192929744s trace: https://jaeger.dev.storj.io/trace/5e8e3ddb11d5e892 FAIL (2025-12-09 15:48:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:57908->45.38.24.2:443: read: connection reset by peer Duration: 5.192957286s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [X.X.X..X....X.......................XX..................X...] duration: 11.011664149s trace: https://jaeger.dev.storj.io/trace/7e3fae7b586d38d6 FAIL (2025-12-09 15:48:26 UTC) orbiter warning: context deadline exceeded Duration: 11.011688133s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 22 out of 60 is failed (threshold=6) [.X.XXXX.XX...X......X...X.XX...X....X...X...X.X..XX...XX.X..] duration: 5.000700646s trace: https://jaeger.dev.storj.io/trace/2a2bf6f26348261f FAIL (2025-12-09 15:48:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000728419s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.........................................X...........X] duration: 30.00277502s trace: https://jaeger.dev.storj.io/trace/593b271687016c4f FAIL (2025-12-09 15:48:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 15:47:50.798824866 (96h18m50.669907901s) [upload=83937]: Starting upload Dec 9 15:47:50.798921369 (96h18m50.670004404s) [upload=83937]: Done starting upload Dec 9 15:47:50.799010178 (96h18m50.670093213s) [upload=83937]: Uploading segments... Dec 9 15:47:50.799294159 (96h18m50.670377204s) [upload=83937]: Got next segment. Inline: false Dec 9 15:47:50.799363250 (96h18m50.670446295s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 15:47:50.799372037 (96h18m50.670455092s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 15:47:51.056426954 (96h18m50.92751001s) [seg_pos={0 0}, upload=83937]: Begin upload segment... Dec 9 15:47:51.056481187 (96h18m50.927564232s) [seg_pos={0 0}, upload=83937]: Done begin upload segment. Dec 9 15:47:51.056513298 (96h18m50.927596343s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.056576559 (96h18m50.927659594s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057100897 (96h18m50.928183942s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.057596040 (96h18m50.928679075s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058125198 (96h18m50.929208243s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058421582 (96h18m50.929504617s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058696356 (96h18m50.929779391s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.058972071 (96h18m50.930055106s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.059347686 (96h18m50.930430721s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.061182009 (96h18m50.932265044s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.062514146 (96h18m50.933597181s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.064197953 (96h18m50.935280998s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.065677489 (96h18m50.936760534s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.067090440 (96h18m50.938173485s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.068340300 (96h18m50.939423345s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:51.069558109 (96h18m50.940641154s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Uploading piece... Dec 9 15:47:52.703886775 (96h18m52.57496981s) [upload=83937]: Next returned nil segment Dec 9 15:47:52.703900601 (96h18m52.574983636s) [upload=83937]: Waiting for error group managing segments... Dec 9 15:47:53.070939400 (96h18m52.942022445s) [noise=true , address=145.79.227.44:4194 , piece_id=6NCPCDJVVV7F2HY4J6MGR3TD6MOHETXWAUQ7H3FU43AGIBZMBWUA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.074549104 (96h18m52.945632139s) [noise=true , address=145.79.227.39:4014 , piece_id=TNJNQ7DJCHPKOMP2KAW75ZCOMHOBPPWH4XX3WQP5OGZRMCIYHVEA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077053072 (96h18m52.948136107s) [noise=true , address=145.79.227.39:4013 , piece_id=IC654IOYAZRRRKM7G34AXHTQA2QNFBWUP53G3Q4KAXCZOKPI6ZNA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.077574054 (96h18m52.948657099s) [noise=true , address=145.79.227.38:4979 , piece_id=BLERVPIAPSSU7VR26NMIQBRHNUCWLPNYI6E5YD52IBM2JV4CSFEQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.084535460 (96h18m52.955618505s) [noise=true , address=145.79.227.16:4911 , piece_id=7FCNYCTIFXMYEQWKFDU5QVN5XFKSO32RVQTVUDPRIZQCS52I4SBQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.090700220 (96h18m52.961783265s) [noise=true , address=145.79.227.27:4691 , piece_id=7TOCUCNX4ZFERAV2USO5TKQ37JL7E6B3WCYJK4DNPWH4GBC2JHJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.091191014 (96h18m52.962274079s) [noise=true , address=145.79.227.7:4294 , piece_id=NK4AXP6SSK37JGO7OINKL3BH4D23Q5VCGBACQENBPA3HRZ3EMJJA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094302989 (96h18m52.965386025s) [noise=true , address=145.79.227.32:4835 , piece_id=TQB4GDUDDWEYTAUHTDLNVNECRPU5UJWMALOL7KU2S6T4GBR5PM3Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.094537586 (96h18m52.965620622s) [noise=true , address=145.79.227.29:4941 , piece_id=WNUYTTG2LWEKL64R35VQUM7WF4WKLOED4NFFKLY4LPEU27WBMAGA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.115109921 (96h18m52.986192966s) [noise=true , address=145.79.227.42:4122 , piece_id=W5A5G7N2J4775C2TUGUFHC2SR7OSA3AQRMDHSLKTS5K2XC3EHCZQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.118417168 (96h18m52.989500213s) [noise=true , address=145.79.227.43:4158 , piece_id=5FKHKDI3C64XWOUFMNNUSG5PPGK4A4HNX3MWMP4E44CW2BYTBP4A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.120155649 (96h18m52.991238684s) [noise=true , address=145.79.227.23:4547 , piece_id=7LLDJKIMPTDCDLTDARQXO3CZYVCD3OZDD7NOHD7EGBP6XUSPXKGQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123155120 (96h18m52.994238155s) [noise=true , address=77.90.31.14:4661 , piece_id=DGHMAMD7ASLQLLW26A2A4L2KVFD5N2FC5GNJO7UP4W3PFBUHU56Q, seg_pos={0 0}, upload=83937]: Done uploading piece. err: <nil> Dec 9 15:47:53.123168146 (96h18m52.994251181s) [seg_pos={0 0}, upload=83937]: Segment reached optimal threshold of 13 pieces. Dec 9 15:47:53.123387333 (96h18m52.994470368s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123397562 (96h18m52.994480597s) [noise=true , address=77.90.31.21:4879 , piece_id=XDXZ7SACIVSTVQWL5JE4J2XI23UANBGE3RFW7EFL7GLHPPTVPUJQ, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123682554 (96h18m52.994765599s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123691131 (96h18m52.994774176s) [noise=true , address=145.79.227.40:4049 , piece_id=MMRUH72XOW5RIXQTVY75LTIB7OHUD7WUUGXRNTNNWYQQ4AJMWWBA, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123939985 (96h18m52.99502303s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Dec 9 15:47:53.123949333 (96h18m52.995032378s) [noise=true , address=77.90.31.21:4878 , piece_id=FEVDKBVRLUKDLP77PHAXUUZWE24ARARZ5EOXJCTWZOGY7ME3GA3A, seg_pos={0 0}, upload=83937]: Long tail cancellation due to optimal threshold Dec 9 15:47:53.123987134 (96h18m52.99507017s) [seg_pos={0 0}, upload=83937]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 15:47:53.124075293 (96h18m52.995158338s) [upload=83937]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 15:47:53.124081745 (96h18m52.99516479s) [upload=83937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 15:48:17.417713882 (96h19m17.288796927s) [upload=83937]: Done uploading segments... Dec 9 15:48:17.417734421 (96h19m17.288817456s) [upload=83937]: Upload finished. err: <nil> Duration: 30.002802401s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 469.265321ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/39a3ed12475253d0 FAIL (2025-12-09 15:47:59 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 469.295798ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 4.872039653s trace: https://jaeger.dev.storj.io/trace/1a72c3cee1ba60f FAIL (2025-12-09 15:47:56 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.872069509s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X....X........................................] duration: 4.296142953s trace: https://jaeger.dev.storj.io/trace/5e8e3ddb11d5e892 FAIL (2025-12-09 15:47:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:57908->45.38.24.2:443: read: connection reset by peer Duration: 4.296170896s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.032005433s trace: https://jaeger.dev.storj.io/trace/2764ea1e2faac6a FAIL (2025-12-09 15:47:47 UTC) orbiter warning: context deadline exceeded Duration: 6.032040218s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.X.X.X..X....X.......................XX..................X..] duration: 10.116477008s trace: https://jaeger.dev.storj.io/trace/7e3fae7b586d38d6 FAIL (2025-12-09 15:47:39 UTC) orbiter warning: context deadline exceeded Duration: 10.116495933s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X....X.......................................] duration: 10.728270783s trace: https://jaeger.dev.storj.io/trace/5e8e3ddb11d5e892 FAIL (2025-12-09 15:47:36 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:57908->45.38.24.2:443: read: connection reset by peer Duration: 10.728298968s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 22 out of 60 is failed (threshold=6) [..X.XXXX.XX...X......X...X.XX...X....X...X...X.X..XX...XX.X.] duration: 4.824372245s trace: https://jaeger.dev.storj.io/trace/2a2bf6f26348261f FAIL (2025-12-09 15:47:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.824406891s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.006600876s trace: https://jaeger.dev.storj.io/trace/1a72c3cee1ba60f FAIL (2025-12-09 15:47:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.00664014s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 470.381435ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/39a3ed12475253d0 FAIL (2025-12-09 15:47:24 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 470.431951ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [..X.X.X..X....X.......................XX..................X.] duration: 11.797579851s trace: https://jaeger.dev.storj.io/trace/7e3fae7b586d38d6 FAIL (2025-12-09 15:47:18 UTC) orbiter warning: context deadline exceeded Duration: 11.797611212s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [X..X.X.X..X....X.......................XX..................X] duration: 30.000903111s trace: https://jaeger.dev.storj.io/trace/7e3fae7b586d38d6 FAIL (2025-12-09 15:46:53 UTC) orbiter warning: context deadline exceeded Duration: 30.000930202s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 9.021932189s trace: https://jaeger.dev.storj.io/trace/2764ea1e2faac6a FAIL (2025-12-09 15:46:52 UTC) orbiter warning: context deadline exceeded Duration: 9.021946546s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.........................................X...........] duration: 5.751091715s trace: https://jaeger.dev.storj.io/trace/16baeebf78bfe8c1 FAIL (2025-12-09 15:46:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 15:36:16.967110371 (96h7m16.838193416s) [upload=83769]: Starting upload Dec 9 15:36:16.967199280 (96h7m16.838282336s) [upload=83769]: Done starting upload Dec 9 15:36:16.967350258 (96h7m16.838433303s) [upload=83769]: Uploading segments... Dec 9 15:36:16.967582550 (96h7m16.838665595s) [upload=83769]: Got next segment. Inline: false Dec 9 15:36:16.967640010 (96h7m16.838723045s) [upload=83769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 15:36:16.967665338 (96h7m16.838748383s) [upload=83769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 15:36:17.214354115 (96h7m17.08543718s) [seg_pos={0 0}, upload=83769]: Begin upload segment... Dec 9 15:36:17.214431642 (96h7m17.085514677s) [seg_pos={0 0}, upload=83769]: Done begin upload segment. Dec 9 15:36:17.214475175 (96h7m17.08555821s) [noise=true , address=145.79.227.42:4122 , piece_id=D2IHZY644S3NCAGKYTGGV63YZQKK32N5AAN77IY7HE4ZX47FBMGQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.214487499 (96h7m17.085570534s) [noise=true , address=77.90.31.21:4878 , piece_id=KNMQZPYPDGIBAO5HKNCD7PGMODNNNSEKFTS6VKB3PKY7NKZQVOBQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.214686377 (96h7m17.085769422s) [noise=true , address=145.79.227.7:4294 , piece_id=3Z7ATOZ6ZCELQLH3EICHYZYRU7P3M4JUFPBUM7HG4QMQRX7RFWAA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.215282744 (96h7m17.086365789s) [noise=true , address=145.79.227.32:4835 , piece_id=6GO2YQ4LPJYH6KLRRWWGYZYU2UNRHKJXYWWTR245THKZS3QGYCXQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.215989178 (96h7m17.087072223s) [noise=true , address=145.79.227.33:4871 , piece_id=WQBSSBDAVSUFIQF73D7YZP3K5HV7ZG6WEZJUCKTPNJYY4MP4JYXA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.216503117 (96h7m17.087586162s) [noise=true , address=145.79.227.43:4158 , piece_id=ON6LCRLJYAHUHIZ3N67GM6BDP3QCIAXRAHLXEESNXZRF6RQ74FAA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.216989754 (96h7m17.088072799s) [noise=true , address=145.79.227.41:4086 , piece_id=K6XZGMI524QAAQIMD52U4PVFZ3C6WTPJ6INL6UFAWLGDJTGIFZWQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.217549590 (96h7m17.088632635s) [noise=true , address=145.79.227.23:4545 , piece_id=OMHD4GCX7JPELOSAWW4ER2UWOVCAY3GPCB3OEEZ2CEYA6GRALTCQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.218177846 (96h7m17.089260891s) [noise=true , address=145.79.227.31:4797 , piece_id=QNLZQJ66FSMIDUCEVKJREGH7M25HOSFCL5UOQ6QFIDX3XLKKI4UQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.218348732 (96h7m17.089431777s) [noise=true , address=145.79.227.39:4013 , piece_id=7Z4IMZRYWEVJMJFVE644ADERTSCF6U6L6TU3R4M3OLPLNBTDSIAQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.218977499 (96h7m17.090060544s) [noise=true , address=145.79.227.25:4618 , piece_id=MWTVTSWUI2PV6HZLYCIJIV5HCVZAACEOPL7BRZ4MVKTZB67Z4MXA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.219658936 (96h7m17.090741981s) [noise=true , address=145.79.227.28:4727 , piece_id=K6DQO4Z3MFXL6T2NGIQAY6GVPXSOH6PZCAOHRS4IDI3EXIWPLB6A, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.221006402 (96h7m17.092089487s) [noise=true , address=145.79.227.42:4123 , piece_id=Y2TEXIXNIDCOEIAWKWYEXEILH7GVLJIF2ZSPUF7Z6ABML2R7CWMQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.222823132 (96h7m17.093906177s) [noise=true , address=145.79.227.44:4194 , piece_id=MQYREDSQVPNV3Z5IONWPUPT46HBSSNBYQKOWGAK3TIJOSDPWFT4Q, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.224329871 (96h7m17.095412916s) [noise=true , address=145.79.227.25:4617 , piece_id=LW3N6GXPB4F6YHVMS6KFTL4HU6J3FJ3EHALY2RJN3WF5XRTMIDIQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.225366445 (96h7m17.09644949s) [noise=true , address=77.90.31.11:4553 , piece_id=2P4VF3FS7ZH5CF5HXJQSZYQAXEJU24FTX5WYECNGRMIAVZ5QXU5A, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:18.932081124 (96h7m18.803164169s) [upload=83769]: Next returned nil segment Dec 9 15:36:18.932099929 (96h7m18.803182974s) [upload=83769]: Waiting for error group managing segments... Dec 9 15:36:19.226912364 (96h7m19.097995409s) [noise=true , address=145.79.227.32:4835 , piece_id=6GO2YQ4LPJYH6KLRRWWGYZYU2UNRHKJXYWWTR245THKZS3QGYCXQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.228702442 (96h7m19.099785487s) [noise=true , address=145.79.227.25:4618 , piece_id=MWTVTSWUI2PV6HZLYCIJIV5HCVZAACEOPL7BRZ4MVKTZB67Z4MXA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.231270542 (96h7m19.102353577s) [noise=true , address=145.79.227.41:4086 , piece_id=K6XZGMI524QAAQIMD52U4PVFZ3C6WTPJ6INL6UFAWLGDJTGIFZWQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.233922161 (96h7m19.105005206s) [noise=true , address=145.79.227.43:4158 , piece_id=ON6LCRLJYAHUHIZ3N67GM6BDP3QCIAXRAHLXEESNXZRF6RQ74FAA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.234211232 (96h7m19.105294278s) [noise=true , address=145.79.227.7:4294 , piece_id=3Z7ATOZ6ZCELQLH3EICHYZYRU7P3M4JUFPBUM7HG4QMQRX7RFWAA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.237341632 (96h7m19.108424677s) [noise=true , address=145.79.227.42:4122 , piece_id=D2IHZY644S3NCAGKYTGGV63YZQKK32N5AAN77IY7HE4ZX47FBMGQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.252371513 (96h7m19.123454548s) [noise=true , address=145.79.227.25:4617 , piece_id=LW3N6GXPB4F6YHVMS6KFTL4HU6J3FJ3EHALY2RJN3WF5XRTMIDIQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.260637514 (96h7m19.131720559s) [noise=true , address=145.79.227.28:4727 , piece_id=K6DQO4Z3MFXL6T2NGIQAY6GVPXSOH6PZCAOHRS4IDI3EXIWPLB6A, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.276234433 (96h7m19.147317478s) [noise=true , address=145.79.227.33:4871 , piece_id=WQBSSBDAVSUFIQF73D7YZP3K5HV7ZG6WEZJUCKTPNJYY4MP4JYXA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.285898134 (96h7m19.15698117s) [noise=true , address=145.79.227.39:4013 , piece_id=7Z4IMZRYWEVJMJFVE644ADERTSCF6U6L6TU3R4M3OLPLNBTDSIAQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.290667396 (96h7m19.161750451s) [noise=true , address=145.79.227.31:4797 , piece_id=QNLZQJ66FSMIDUCEVKJREGH7M25HOSFCL5UOQ6QFIDX3XLKKI4UQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.307872819 (96h7m19.178955864s) [noise=true , address=77.90.31.11:4553 , piece_id=2P4VF3FS7ZH5CF5HXJQSZYQAXEJU24FTX5WYECNGRMIAVZ5QXU5A, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.318191999 (96h7m19.189275034s) [noise=true , address=145.79.227.23:4545 , piece_id=OMHD4GCX7JPELOSAWW4ER2UWOVCAY3GPCB3OEEZ2CEYA6GRALTCQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.318211936 (96h7m19.189294981s) [seg_pos={0 0}, upload=83769]: Segment reached optimal threshold of 13 pieces. Dec 9 15:36:19.318392150 (96h7m19.189475195s) [noise=true , address=145.79.227.42:4123 , piece_id=Y2TEXIXNIDCOEIAWKWYEXEILH7GVLJIF2ZSPUF7Z6ABML2R7CWMQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: expected piece hash; context canceled; EOF Dec 9 15:36:19.318400736 (96h7m19.189483791s) [noise=true , address=145.79.227.42:4123 , piece_id=Y2TEXIXNIDCOEIAWKWYEXEILH7GVLJIF2ZSPUF7Z6ABML2R7CWMQ, seg_pos={0 0}, upload=83769]: Long tail cancellation due to optimal threshold Dec 9 15:36:19.318677213 (96h7m19.189760248s) [noise=true , address=145.79.227.44:4194 , piece_id=MQYREDSQVPNV3Z5IONWPUPT46HBSSNBYQKOWGAK3TIJOSDPWFT4Q, seg_pos={0 0}, upload=83769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Dec 9 15:36:19.318683785 (96h7m19.18976682s) [noise=true , address=145.79.227.44:4194 , piece_id=MQYREDSQVPNV3Z5IONWPUPT46HBSSNBYQKOWGAK3TIJOSDPWFT4Q, seg_pos={0 0}, upload=83769]: Long tail cancellation due to optimal threshold Dec 9 15:36:19.318802862 (96h7m19.189885897s) [noise=true , address=77.90.31.21:4878 , piece_id=KNMQZPYPDGIBAO5HKNCD7PGMODNNNSEKFTS6VKB3PKY7NKZQVOBQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Dec 9 15:36:19.318809064 (96h7m19.189892109s) [noise=true , address=77.90.31.21:4878 , piece_id=KNMQZPYPDGIBAO5HKNCD7PGMODNNNSEKFTS6VKB3PKY7NKZQVOBQ, seg_pos={0 0}, upload=83769]: Long tail cancellation due to optimal threshold Dec 9 15:36:19.318831346 (96h7m19.189914391s) [seg_pos={0 0}, upload=83769]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 15:36:19.318939562 (96h7m19.190022597s) [upload=83769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 15:36:19.318946967 (96h7m19.190030012s) [upload=83769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 15:38:42.350673908 (96h9m42.221756953s) [upload=83769]: Done uploading segments... Dec 9 15:38:42.350824724 (96h9m42.221907759s) [upload=83769]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.751112324s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 20.431996139s trace: https://jaeger.dev.storj.io/trace/2764ea1e2faac6a FAIL (2025-12-09 15:46:42 UTC) orbiter warning: context deadline exceeded Duration: 20.432027528s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 23 out of 60 is failed (threshold=6) [X..X.XXXX.XX...X......X...X.XX...X....X...X...X.X..XX...XX.X] duration: 5.000606772s trace: https://jaeger.dev.storj.io/trace/2a2bf6f26348261f FAIL (2025-12-09 15:46:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000621209s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X....X......................................] duration: 5.093218178s trace: https://jaeger.dev.storj.io/trace/5e8e3ddb11d5e892 FAIL (2025-12-09 15:46:30 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:57908->45.38.24.2:443: read: connection reset by peer Duration: 5.093234158s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.030898616s trace: https://jaeger.dev.storj.io/trace/1a72c3cee1ba60f FAIL (2025-12-09 15:46:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.030936117s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.........................................X..........] duration: 5.788964792s trace: https://jaeger.dev.storj.io/trace/16baeebf78bfe8c1 FAIL (2025-12-09 15:46:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 15:36:16.967110371 (96h7m16.838193416s) [upload=83769]: Starting upload Dec 9 15:36:16.967199280 (96h7m16.838282336s) [upload=83769]: Done starting upload Dec 9 15:36:16.967350258 (96h7m16.838433303s) [upload=83769]: Uploading segments... Dec 9 15:36:16.967582550 (96h7m16.838665595s) [upload=83769]: Got next segment. Inline: false Dec 9 15:36:16.967640010 (96h7m16.838723045s) [upload=83769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 15:36:16.967665338 (96h7m16.838748383s) [upload=83769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 15:36:17.214354115 (96h7m17.08543718s) [seg_pos={0 0}, upload=83769]: Begin upload segment... Dec 9 15:36:17.214431642 (96h7m17.085514677s) [seg_pos={0 0}, upload=83769]: Done begin upload segment. Dec 9 15:36:17.214475175 (96h7m17.08555821s) [noise=true , address=145.79.227.42:4122 , piece_id=D2IHZY644S3NCAGKYTGGV63YZQKK32N5AAN77IY7HE4ZX47FBMGQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.214487499 (96h7m17.085570534s) [noise=true , address=77.90.31.21:4878 , piece_id=KNMQZPYPDGIBAO5HKNCD7PGMODNNNSEKFTS6VKB3PKY7NKZQVOBQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.214686377 (96h7m17.085769422s) [noise=true , address=145.79.227.7:4294 , piece_id=3Z7ATOZ6ZCELQLH3EICHYZYRU7P3M4JUFPBUM7HG4QMQRX7RFWAA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.215282744 (96h7m17.086365789s) [noise=true , address=145.79.227.32:4835 , piece_id=6GO2YQ4LPJYH6KLRRWWGYZYU2UNRHKJXYWWTR245THKZS3QGYCXQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.215989178 (96h7m17.087072223s) [noise=true , address=145.79.227.33:4871 , piece_id=WQBSSBDAVSUFIQF73D7YZP3K5HV7ZG6WEZJUCKTPNJYY4MP4JYXA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.216503117 (96h7m17.087586162s) [noise=true , address=145.79.227.43:4158 , piece_id=ON6LCRLJYAHUHIZ3N67GM6BDP3QCIAXRAHLXEESNXZRF6RQ74FAA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.216989754 (96h7m17.088072799s) [noise=true , address=145.79.227.41:4086 , piece_id=K6XZGMI524QAAQIMD52U4PVFZ3C6WTPJ6INL6UFAWLGDJTGIFZWQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.217549590 (96h7m17.088632635s) [noise=true , address=145.79.227.23:4545 , piece_id=OMHD4GCX7JPELOSAWW4ER2UWOVCAY3GPCB3OEEZ2CEYA6GRALTCQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.218177846 (96h7m17.089260891s) [noise=true , address=145.79.227.31:4797 , piece_id=QNLZQJ66FSMIDUCEVKJREGH7M25HOSFCL5UOQ6QFIDX3XLKKI4UQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.218348732 (96h7m17.089431777s) [noise=true , address=145.79.227.39:4013 , piece_id=7Z4IMZRYWEVJMJFVE644ADERTSCF6U6L6TU3R4M3OLPLNBTDSIAQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.218977499 (96h7m17.090060544s) [noise=true , address=145.79.227.25:4618 , piece_id=MWTVTSWUI2PV6HZLYCIJIV5HCVZAACEOPL7BRZ4MVKTZB67Z4MXA, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.219658936 (96h7m17.090741981s) [noise=true , address=145.79.227.28:4727 , piece_id=K6DQO4Z3MFXL6T2NGIQAY6GVPXSOH6PZCAOHRS4IDI3EXIWPLB6A, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.221006402 (96h7m17.092089487s) [noise=true , address=145.79.227.42:4123 , piece_id=Y2TEXIXNIDCOEIAWKWYEXEILH7GVLJIF2ZSPUF7Z6ABML2R7CWMQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.222823132 (96h7m17.093906177s) [noise=true , address=145.79.227.44:4194 , piece_id=MQYREDSQVPNV3Z5IONWPUPT46HBSSNBYQKOWGAK3TIJOSDPWFT4Q, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.224329871 (96h7m17.095412916s) [noise=true , address=145.79.227.25:4617 , piece_id=LW3N6GXPB4F6YHVMS6KFTL4HU6J3FJ3EHALY2RJN3WF5XRTMIDIQ, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:17.225366445 (96h7m17.09644949s) [noise=true , address=77.90.31.11:4553 , piece_id=2P4VF3FS7ZH5CF5HXJQSZYQAXEJU24FTX5WYECNGRMIAVZ5QXU5A, seg_pos={0 0}, upload=83769]: Uploading piece... Dec 9 15:36:18.932081124 (96h7m18.803164169s) [upload=83769]: Next returned nil segment Dec 9 15:36:18.932099929 (96h7m18.803182974s) [upload=83769]: Waiting for error group managing segments... Dec 9 15:36:19.226912364 (96h7m19.097995409s) [noise=true , address=145.79.227.32:4835 , piece_id=6GO2YQ4LPJYH6KLRRWWGYZYU2UNRHKJXYWWTR245THKZS3QGYCXQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.228702442 (96h7m19.099785487s) [noise=true , address=145.79.227.25:4618 , piece_id=MWTVTSWUI2PV6HZLYCIJIV5HCVZAACEOPL7BRZ4MVKTZB67Z4MXA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.231270542 (96h7m19.102353577s) [noise=true , address=145.79.227.41:4086 , piece_id=K6XZGMI524QAAQIMD52U4PVFZ3C6WTPJ6INL6UFAWLGDJTGIFZWQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.233922161 (96h7m19.105005206s) [noise=true , address=145.79.227.43:4158 , piece_id=ON6LCRLJYAHUHIZ3N67GM6BDP3QCIAXRAHLXEESNXZRF6RQ74FAA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.234211232 (96h7m19.105294278s) [noise=true , address=145.79.227.7:4294 , piece_id=3Z7ATOZ6ZCELQLH3EICHYZYRU7P3M4JUFPBUM7HG4QMQRX7RFWAA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.237341632 (96h7m19.108424677s) [noise=true , address=145.79.227.42:4122 , piece_id=D2IHZY644S3NCAGKYTGGV63YZQKK32N5AAN77IY7HE4ZX47FBMGQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.252371513 (96h7m19.123454548s) [noise=true , address=145.79.227.25:4617 , piece_id=LW3N6GXPB4F6YHVMS6KFTL4HU6J3FJ3EHALY2RJN3WF5XRTMIDIQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.260637514 (96h7m19.131720559s) [noise=true , address=145.79.227.28:4727 , piece_id=K6DQO4Z3MFXL6T2NGIQAY6GVPXSOH6PZCAOHRS4IDI3EXIWPLB6A, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.276234433 (96h7m19.147317478s) [noise=true , address=145.79.227.33:4871 , piece_id=WQBSSBDAVSUFIQF73D7YZP3K5HV7ZG6WEZJUCKTPNJYY4MP4JYXA, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.285898134 (96h7m19.15698117s) [noise=true , address=145.79.227.39:4013 , piece_id=7Z4IMZRYWEVJMJFVE644ADERTSCF6U6L6TU3R4M3OLPLNBTDSIAQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.290667396 (96h7m19.161750451s) [noise=true , address=145.79.227.31:4797 , piece_id=QNLZQJ66FSMIDUCEVKJREGH7M25HOSFCL5UOQ6QFIDX3XLKKI4UQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.307872819 (96h7m19.178955864s) [noise=true , address=77.90.31.11:4553 , piece_id=2P4VF3FS7ZH5CF5HXJQSZYQAXEJU24FTX5WYECNGRMIAVZ5QXU5A, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.318191999 (96h7m19.189275034s) [noise=true , address=145.79.227.23:4545 , piece_id=OMHD4GCX7JPELOSAWW4ER2UWOVCAY3GPCB3OEEZ2CEYA6GRALTCQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: <nil> Dec 9 15:36:19.318211936 (96h7m19.189294981s) [seg_pos={0 0}, upload=83769]: Segment reached optimal threshold of 13 pieces. Dec 9 15:36:19.318392150 (96h7m19.189475195s) [noise=true , address=145.79.227.42:4123 , piece_id=Y2TEXIXNIDCOEIAWKWYEXEILH7GVLJIF2ZSPUF7Z6ABML2R7CWMQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: expected piece hash; context canceled; EOF Dec 9 15:36:19.318400736 (96h7m19.189483791s) [noise=true , address=145.79.227.42:4123 , piece_id=Y2TEXIXNIDCOEIAWKWYEXEILH7GVLJIF2ZSPUF7Z6ABML2R7CWMQ, seg_pos={0 0}, upload=83769]: Long tail cancellation due to optimal threshold Dec 9 15:36:19.318677213 (96h7m19.189760248s) [noise=true , address=145.79.227.44:4194 , piece_id=MQYREDSQVPNV3Z5IONWPUPT46HBSSNBYQKOWGAK3TIJOSDPWFT4Q, seg_pos={0 0}, upload=83769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Dec 9 15:36:19.318683785 (96h7m19.18976682s) [noise=true , address=145.79.227.44:4194 , piece_id=MQYREDSQVPNV3Z5IONWPUPT46HBSSNBYQKOWGAK3TIJOSDPWFT4Q, seg_pos={0 0}, upload=83769]: Long tail cancellation due to optimal threshold Dec 9 15:36:19.318802862 (96h7m19.189885897s) [noise=true , address=77.90.31.21:4878 , piece_id=KNMQZPYPDGIBAO5HKNCD7PGMODNNNSEKFTS6VKB3PKY7NKZQVOBQ, seg_pos={0 0}, upload=83769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Dec 9 15:36:19.318809064 (96h7m19.189892109s) [noise=true , address=77.90.31.21:4878 , piece_id=KNMQZPYPDGIBAO5HKNCD7PGMODNNNSEKFTS6VKB3PKY7NKZQVOBQ, seg_pos={0 0}, upload=83769]: Long tail cancellation due to optimal threshold Dec 9 15:36:19.318831346 (96h7m19.189914391s) [seg_pos={0 0}, upload=83769]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 15:36:19.318939562 (96h7m19.190022597s) [upload=83769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 15:36:19.318946967 (96h7m19.190030012s) [upload=83769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 15:38:42.350673908 (96h9m42.221756953s) [upload=83769]: Done uploading segments... Dec 9 15:38:42.350824724 (96h9m42.221907759s) [upload=83769]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.788986122s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X....X.....................................] duration: 5.114449642s trace: https://jaeger.dev.storj.io/trace/5e8e3ddb11d5e892 FAIL (2025-12-09 15:46:15 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:57908->45.38.24.2:443: read: connection reset by peer Duration: 5.114482174s edge gateway us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 471.53943ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/39a3ed12475253d0 FAIL (2025-12-09 15:46:12 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 471.633831ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.X..X.X.X..X....X.......................XX..................] duration: 15.64969355s trace: https://jaeger.dev.storj.io/trace/54e64010ea148589 FAIL (2025-12-09 15:46:05 UTC) orbiter warning: context deadline exceeded Duration: 15.64972015s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.043237499s trace: https://jaeger.dev.storj.io/trace/1a72c3cee1ba60f FAIL (2025-12-09 15:45:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.043258088s core uplink eu1

1
...
11593
11594
11595
11596
11597
...
17404