Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.363347955s trace: https://jaeger.dev.storj.io/trace/775323a46ba4bd95 FAIL (2025-12-08 08:32:48 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 5.363385737s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X..X........................] duration: 2.909779771s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:32:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.909809217s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 748.275261ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 08:32:22 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 748.304617ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.003257332s trace: https://jaeger.dev.storj.io/trace/5699b43ed41f47e3 FAIL (2025-12-08 08:32:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.003386076s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X..X.......................] duration: 2.069696784s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:32:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.069729336s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 696.230262ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 08:32:04 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 696.328178ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 7.184146662s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 08:32:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.184174786s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..................X........................X......X.........] duration: 3.525001602s trace: https://jaeger.dev.storj.io/trace/5713ceca9b4db6c3 FAIL (2025-12-08 08:32:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.525030338s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.746533663s trace: https://jaeger.dev.storj.io/trace/775323a46ba4bd95 FAIL (2025-12-08 08:31:57 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 5.746559471s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.........XX.........X...............X..................X....] duration: 5.7814532s trace: https://jaeger.dev.storj.io/trace/2f4fe333e33b8feb FAIL (2025-12-08 08:31:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.781485932s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X..............................XX..........] duration: 7.260578936s trace: https://jaeger.dev.storj.io/trace/21e18bb10e952a93 FAIL (2025-12-08 08:31:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 7.260642597s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..X......................] duration: 3.105204916s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:31:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 3.105237598s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...................X........................X......X........] duration: 3.361573825s trace: https://jaeger.dev.storj.io/trace/5713ceca9b4db6c3 FAIL (2025-12-08 08:31:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.361639248s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..........XX.........X...............X..................X...] duration: 5.745678651s trace: https://jaeger.dev.storj.io/trace/2f4fe333e33b8feb FAIL (2025-12-08 08:31:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.745701185s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X..............................XX.........] duration: 7.340829253s trace: https://jaeger.dev.storj.io/trace/21e18bb10e952a93 FAIL (2025-12-08 08:31:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 7.34085872s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 4.83343204s trace: https://jaeger.dev.storj.io/trace/5699b43ed41f47e3 FAIL (2025-12-08 08:31:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.833476295s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [...........XX.........X...............X..................X..] duration: 5.820012994s trace: https://jaeger.dev.storj.io/trace/2f4fe333e33b8feb FAIL (2025-12-08 08:31:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.820085973s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 709.198635ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 08:30:59 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 709.231657ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 9.022212619s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 08:30:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 9.022238909s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.70246144s trace: https://jaeger.dev.storj.io/trace/775323a46ba4bd95 FAIL (2025-12-08 08:30:52 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 5.702495996s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.893214741s trace: https://jaeger.dev.storj.io/trace/5699b43ed41f47e3 FAIL (2025-12-08 08:30:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.89324549s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [............XX.........X...............X..................X.] duration: 5.977712043s trace: https://jaeger.dev.storj.io/trace/2f4fe333e33b8feb FAIL (2025-12-08 08:30:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.977736709s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [....................X........................X......X.......] duration: 3.544254852s trace: https://jaeger.dev.storj.io/trace/5713ceca9b4db6c3 FAIL (2025-12-08 08:30:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.544307883s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X..X.....................] duration: 2.822224755s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:30:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.822289378s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.............XX.........X...............X..................X] duration: 1m0.00068002s trace: https://jaeger.dev.storj.io/trace/2f4fe333e33b8feb FAIL (2025-12-08 08:30:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000706411s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X..............................XX........] duration: 6.001362555s trace: https://jaeger.dev.storj.io/trace/21e18bb10e952a93 FAIL (2025-12-08 08:30:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.001394125s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.072058694s trace: https://jaeger.dev.storj.io/trace/775323a46ba4bd95 FAIL (2025-12-08 08:30:04 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 6.072095784s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..X....................] duration: 1.999570717s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:29:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.999600914s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 7.793763437s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 08:29:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.793795199s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 691.408831ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 08:29:50 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 691.43995ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X..............................XX.......] duration: 5.76900506s trace: https://jaeger.dev.storj.io/trace/21e18bb10e952a93 FAIL (2025-12-08 08:29:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.76903697s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.830736799s trace: https://jaeger.dev.storj.io/trace/5699b43ed41f47e3 FAIL (2025-12-08 08:29:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.830764871s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.....................X........................X......X......] duration: 3.534592384s trace: https://jaeger.dev.storj.io/trace/5713ceca9b4db6c3 FAIL (2025-12-08 08:29:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.534618083s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..X...................] duration: 2.073344632s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:29:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.073374508s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X..............................XX......] duration: 5.776720122s trace: https://jaeger.dev.storj.io/trace/21e18bb10e952a93 FAIL (2025-12-08 08:29:06 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.776754368s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..X..................] duration: 2.002768976s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:28:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.002798983s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 700.457219ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 08:28:56 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 700.485353ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.162719891s trace: https://jaeger.dev.storj.io/trace/775323a46ba4bd95 FAIL (2025-12-08 08:28:55 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 6.162748527s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X..............................XX.....] duration: 5.892827863s trace: https://jaeger.dev.storj.io/trace/21e18bb10e952a93 FAIL (2025-12-08 08:28:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.892849353s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.731854413s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 08:28:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.731886425s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.769985648s trace: https://jaeger.dev.storj.io/trace/5699b43ed41f47e3 FAIL (2025-12-08 08:28:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.770017799s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..............................XX....] duration: 5.644206916s trace: https://jaeger.dev.storj.io/trace/21e18bb10e952a93 FAIL (2025-12-08 08:28:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.644241794s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 9.256818679s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 08:28:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 9.256847064s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............XX.........X...............X..................] duration: 5.801498259s trace: https://jaeger.dev.storj.io/trace/396bcc0ee1169960 FAIL (2025-12-08 08:28:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.801543094s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......................X........................X......X.....] duration: 3.506543094s trace: https://jaeger.dev.storj.io/trace/5713ceca9b4db6c3 FAIL (2025-12-08 08:28:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.506576848s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.100062501s trace: https://jaeger.dev.storj.io/trace/5699b43ed41f47e3 FAIL (2025-12-08 08:28:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.100089183s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.109860876s trace: https://jaeger.dev.storj.io/trace/775323a46ba4bd95 FAIL (2025-12-08 08:28:00 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 6.109891374s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 8.114376664s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 08:27:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.114425237s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..X.................] duration: 2.090528902s trace: https://jaeger.dev.storj.io/trace/23e4fea4d1c3bcb8 FAIL (2025-12-08 08:27:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 08:16:58.813434894 (64h47m58.684517929s) [upload=56813]: Starting upload Dec 8 08:16:58.813552538 (64h47m58.684635583s) [upload=56813]: Done starting upload Dec 8 08:16:58.813656476 (64h47m58.684739521s) [upload=56813]: Uploading segments... Dec 8 08:16:58.813718364 (64h47m58.684801409s) [upload=56813]: Got next segment. Inline: true Dec 8 08:16:58.813724626 (64h47m58.684807661s) [upload=56813]: Waiting for error group managing segments... Dec 8 08:16:58.813831950 (64h47m58.684914995s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 08:16:58.813839474 (64h47m58.68492254s) [upload=56813]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 08:16:58.813843732 (64h47m58.684926777s) [upload=56813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 08:17:25.151880477 (64h48m25.022963512s) [upload=56813]: Done uploading segments... Dec 8 08:17:25.151931593 (64h48m25.023014638s) [upload=56813]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.090557387s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.050334529s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 08:27:51 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.05036071s core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)