Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 44 out of 60 is failed (threshold=3) [.X.....X.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.........] duration: 7.246116998s FAIL (2025-09-06 13:07:57 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 7.246141314s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 36 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..........] duration: 5.080705269s FAIL (2025-09-06 13:07:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 8) ======LOGS====== iece_id=MAPFBSPKCDEVIDXSGODTYSWR4HSDF3R6FWSEPLIZCQVZWRRIWT5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection Sep 6 13:00:45.733303268 (190h52m42.413498837s) [noise=true , address=185.167.204.206:4041 , piece_id=PJATWZNODOXWXL56LYPO3AMWFGRKLQNWQAWWFWHK4JI5PXHYXEPA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection Sep 6 13:00:45.733477351 (190h52m42.41367293s) [noise=true , address=185.167.204.205:4018 , piece_id=AXKSZN3HADHS3YT63O5PF5NBHNNR6CUUXAMCFRRROCHINERFQH5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.733526635 (190h52m42.413722204s) [noise=true , address=185.167.204.205:4034 , piece_id=FNRLEMKI64OP33HMR5C7ZH6LTVCH4PY2FHHINN44VL5CCUN5YJSQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: read tcp 188.166.225.170:48882->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.733771123 (190h52m42.413966692s) [noise=true , address=185.167.204.206:4053 , piece_id=HCWYRCASJ4HHD7KNL4LAIGM3NZTD2HBMJUCHNB6PNEP6VPY3456A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.734016713 (190h52m42.414212282s) [noise=true , address=185.167.204.205:4030 , piece_id=VKD6MXE6HP7GKWTJ7N75GIORGJNMIP3JNA2ELLG4UGFI5NQ3QQYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection Sep 6 13:00:45.734081286 (190h52m42.414276865s) [noise=true , address=185.167.204.206:4072 , piece_id=S4GSGX2V6DKN65XKFKQRP6VKC3FGMNX2TACNYFAQW3NAAABDDN4Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: read tcp 188.166.225.170:37318->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734144167 (190h52m42.414339746s) [noise=true , address=81.171.14.70:4031 , piece_id=N23GESXOXK7YN5NZCO6MR3YQEW63AEGZ2S7BZINDMSIGWBDW7C7A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection Sep 6 13:00:45.734225884 (190h52m42.414421453s) [noise=true , address=185.167.204.206:4050 , piece_id=KBKRVPSSNR3VXO4EUVASUFJXSKLXA7DNCRZ5ITKEFP5KIG6RXMKA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection Sep 6 13:00:45.734277362 (190h52m42.414472931s) [noise=true , address=185.167.204.205:4026 , piece_id=IFKAKMYEQ3XF7IZF2CVIONOABON6JDRTXHOQF6B6NTBWMUOBXWYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 188.166.225.170:59156->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734286389 (190h52m42.414481958s) [noise=true , address=185.167.204.205:4013 , piece_id=KFCOA7R77L3MKNXFSZXNI2CRLAAORK7AZSITMUVJXJJHLQUOZUAA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection Sep 6 13:00:45.734343248 (190h52m42.414538817s) [noise=true , address=185.167.204.205:4023 , piece_id=2HTXOAHW3RDHWLKH7VDEF27E2PGFNEZS7POOS5E7EMV6RNS25MLQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection Sep 6 13:00:45.734367104 (190h52m42.414562673s) [noise=true , address=185.167.204.206:4070 , piece_id=TM4G5XMOOKJQ5B2BY52QS7DZTUINDJRMKOYSEDHURPKSZQGPBBWA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection Sep 6 13:00:45.734410847 (190h52m42.414606416s) [noise=true , address=185.167.204.205:4020 , piece_id=A2NQE2NC5X2YI3GQAOAM4E2MRVPICXAU5VU2M3D6JI3X6PM2JWRQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection Sep 6 13:00:45.734443049 (190h52m42.414638618s) [noise=true , address=185.167.204.206:4054 , piece_id=JDNA5IDSNXNAH4REIYKZKNFHDKR7E3AWGJA7VEVI4NAPMYP5FZXA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection Sep 6 13:00:45.734461584 (190h52m42.414657153s) [noise=true , address=185.167.204.206:4052 , piece_id=NVOLPFSQA6EVOXY3KWBXCBTSUQEO4336TVXZ6BHD4KR76QV3RHIA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: read tcp 188.166.225.170:49118->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734474489 (190h52m42.414670058s) [noise=true , address=185.167.204.205:4032 , piece_id=7U5JZGQCNNGHNJBOPW4CCDE7JDLJNQXIHGZ3VQXNJYWPNVO5YDMA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection Sep 6 13:00:45.734518212 (190h52m42.414713792s) [seg_pos={0 0}, upload=167832]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil> Sep 6 13:00:45.907410026 (190h52m42.587605595s) [upload=167832]: Done uploading segments... Sep 6 13:00:45.907441366 (190h52m42.587636935s) [upload=167832]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8) Duration: 5.080736106s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 23 out of 60 is failed (threshold=3) [........X.XX.XXX.XXXX....XXX..X.X.....X.XX.X...XXXX.........] duration: 3.635482072s FAIL (2025-09-06 13:07:46 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 13:00:21.385451159 (190h52m18.065646759s) [upload=167839]: Starting upload Sep 6 13:00:21.385573654 (190h52m18.065769233s) [upload=167839]: Done starting upload Sep 6 13:00:21.385682032 (190h52m18.065877601s) [upload=167839]: Uploading segments... Sep 6 13:00:21.385790509 (190h52m18.065986078s) [upload=167839]: Got next segment. Inline: true Sep 6 13:00:21.385820957 (190h52m18.066016527s) [upload=167839]: Waiting for error group managing segments... Sep 6 13:00:21.385871655 (190h52m18.066067224s) [upload=167839]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 13:00:21.385876985 (190h52m18.066072554s) [upload=167839]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 13:00:21.385880070 (190h52m18.066075639s) [upload=167839]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 13:00:23.550369185 (190h52m20.230564764s) [upload=167839]: Done uploading segments... Sep 6 13:00:23.550388793 (190h52m20.230584362s) [upload=167839]: Upload finished. err: <nil> Duration:* 3.635520867s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 45 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...........] duration: 5.840601313s FAIL (2025-09-06 13:07:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.840619738s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 32 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.........] duration: 12.294445557s FAIL (2025-09-06 13:07:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== 0:32792->77.90.31.17:4796: use of closed network connection; write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection Sep 6 13:00:58.212486355 (190h52m54.892681924s) [noise=true , address=145.79.227.31:4825 , piece_id=57YANVBSITJTAZOJSCVVJLX4KGSFVY6QGLL3NXATT7YAXP5VILXQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12AYyhgZh7oAaGf4EXLSp6s1csFxCKfLuh6CJAPyzdC6pLQ51h, address:145.79.227.31:4825): protocol: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection Sep 6 13:00:58.212528175 (190h52m54.892723744s) [noise=true , address=77.90.31.13:4660 , piece_id=YNQXH3AAYLSUMJ5BLCVQVTTSZKMKAAUELBZ76Y4LQECLDADGOMSQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG, address:77.90.31.13:4660): protocol: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection Sep 6 13:00:58.212564826 (190h52m54.892760395s) [noise=true , address=145.79.227.14:4865 , piece_id=7LO6DCPQDVHY7Y47PZZFUXFW55AHB5WSIRHOSSLPZFNJTQSGLL5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL, address:145.79.227.14:4865): protocol: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection Sep 6 13:00:58.212576077 (190h52m54.892771646s) [noise=true , address=145.79.227.33:4878 , piece_id=C3U6RCAOUOIDZFVCOK3IBYUR2D3THF7S7XLN3UZSA3Z4LGGOCGNA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y, address:145.79.227.33:4878): protocol: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection Sep 6 13:00:58.212616413 (190h52m54.892811982s) [noise=true , address=145.79.227.5:4241 , piece_id=SY3CGY4QDPZJHP2FTMLJI7FY7VY3Y66BUZQNO65FE4BYSXS7YG5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR, address:145.79.227.5:4241): protocol: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection Sep 6 13:00:58.212624720 (190h52m54.892820289s) [noise=true , address=145.79.227.4:4197 , piece_id=HHJ4A63PZID3ZHQUD3OENTOIGXL6HY64YXJELF4JRLKQ7V3H36BA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1cB89C5xnya9WGD9dGBsSouqkZH3nLqytrg9Qo4UH2kdFonTjM, address:145.79.227.4:4197): protocol: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection Sep 6 13:00:58.212660899 (190h52m54.892856468s) [noise=true , address=77.90.31.18:4832 , piece_id=74UQB3G7FYNQFYGAS3SBLC6W7ECN7SSXQXF5N4PW3QSL3GJ3C7IA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12QnZ3q9oe4zPuLpS3V1DCBhyaU1umS5B7bpuAqPkaaY96ErWbo, address:77.90.31.18:4832): protocol: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection Sep 6 13:00:58.212689103 (190h52m54.892884672s) [noise=true , address=145.79.227.15:4892 , piece_id=HAMHVBFROPFJOMUGZBNGZ4BNMKWP375DRKXKHDI6BHIDOHRZN6KQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:145.79.227.15:4892): protocol: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection Sep 6 13:00:58.212702549 (190h52m54.892898118s) [noise=true , address=64.49.13.155:4923 , piece_id=C2NNEN5BWAWXCESYBELSDCP6PUXMLAS2I6YYFLYQ6CSCBOFYOBEQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z, address:64.49.13.155:4923): protocol: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection Sep 6 13:00:58.212734530 (190h52m54.892930099s) [noise=true , address=145.79.227.43:4176 , piece_id=ZDQ2VVCGVELEF7UFEY2B7WEOQGM4RWYKDJEC7ON7BTFQ7GLTIR7A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD, address:145.79.227.43:4176): protocol: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection Sep 6 13:00:58.212741814 (190h52m54.892937383s) [noise=true , address=145.79.227.11:4763 , piece_id=GMCGUDCCOSOAULHI25BSPCJANDXLZVWJTKTQ4SZH6ZKCPKYGMMWQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12P642GmVJzz139WqNE7AZFGieZUk1dNQPwEJ3RSeWVJ4xUZPuZ, address:145.79.227.11:4763): protocol: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection Sep 6 13:00:58.212795466 (190h52m54.892991036s) [noise=true , address=77.90.31.21:4910 , piece_id=6RNZHM6HLMOP66FNN6HWWOWKBALD452U6RQ5OSYFNYWI5H2NXAVQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12onFkiP1wSRcNuzyqegL2EjfttSrQ5AMJwfp9PBn5urHQb3C2H, address:77.90.31.21:4910): protocol: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection Sep 6 13:00:58.212816487 (190h52m54.893012056s) [noise=true , address=145.79.227.37:4583 , piece_id=F5HEKDV2VA7COUAI7L3O75BNBHWSTSKQJTXUFPBSYJLOEA5SBEIA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection Sep 6 13:00:58.212832727 (190h52m54.893028306s) [noise=true , address=77.90.31.10:4536 , piece_id=M5ZVVDRCCCZ6XFCY4FKRMXQPOH5BIGJCICAIO3O4GTCOJ7V4TB5Q, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen, address:77.90.31.10:4536): protocol: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection Sep 6 13:00:58.212842156 (190h52m54.893037725s) [noise=true , address=145.79.227.49:4342 , piece_id=HDZOVIFLOG7FRKHQETC3RAILZGZDCQVQRFVE3GVDZ7OOK53BLBEA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection Sep 6 13:00:58.212863476 (190h52m54.893059045s) [seg_pos={0 0}, upload=167835]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Sep 6 13:00:58.481431059 (190h52m55.161626638s) [upload=167835]: Done uploading segments... Sep 6 13:00:58.481462198 (190h52m55.161657797s) [upload=167835]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 12.294472499s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 5 out of 60 is failed (threshold=3) [XX.......X......X..............X............................] duration: 494.147036ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 13:07:45 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 494.17035ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 30 out of 60 is failed (threshold=3) [................XXXXX.XX.XXXXXXXXXXXXXXXXXXXXXX.X...........] duration: 6.280203918s FAIL (2025-09-06 13:07:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.280234257s core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 7 out of 60 is failed (threshold=3) [.....X...X....X............X..X..........X.....X............] duration: 3.432271875s FAIL (2025-09-06 13:07:36 UTC) operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 48) Duration: 3.432302622s core uplink ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [...............X..X........X...........X.........X..........] duration: 767.091352ms FAIL (2025-09-06 13:07:34 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 767.115078ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.........X......X..XXXX.....X.......XX...X.....X............] duration: 5.170868299s FAIL (2025-09-06 13:07:24 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 5.170911661s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 44 out of 60 is failed (threshold=3) [..X.....X.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX........] duration: 24.465973779s FAIL (2025-09-06 13:07:23 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 24.465997064s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 26 out of 60 is failed (threshold=3) [....XXXXXX..X....XX.X..X.XX..XXXXX.X...XXX..XX.XX...........] duration: 2.152552265s FAIL (2025-09-06 13:07:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.152576852s core uplink us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 5 out of 60 is failed (threshold=3) [.XX.......X......X..............X...........................] duration: 456.501831ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 13:07:17 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 456.533201ms edge linksharing us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 34 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...........] duration: 5.760468386s FAIL (2025-09-06 13:07:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.760488106s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 32 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX........] duration: 11.264701751s FAIL (2025-09-06 13:07:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== 0:32792->77.90.31.17:4796: use of closed network connection; write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection Sep 6 13:00:58.212486355 (190h52m54.892681924s) [noise=true , address=145.79.227.31:4825 , piece_id=57YANVBSITJTAZOJSCVVJLX4KGSFVY6QGLL3NXATT7YAXP5VILXQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12AYyhgZh7oAaGf4EXLSp6s1csFxCKfLuh6CJAPyzdC6pLQ51h, address:145.79.227.31:4825): protocol: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection Sep 6 13:00:58.212528175 (190h52m54.892723744s) [noise=true , address=77.90.31.13:4660 , piece_id=YNQXH3AAYLSUMJ5BLCVQVTTSZKMKAAUELBZ76Y4LQECLDADGOMSQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG, address:77.90.31.13:4660): protocol: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection Sep 6 13:00:58.212564826 (190h52m54.892760395s) [noise=true , address=145.79.227.14:4865 , piece_id=7LO6DCPQDVHY7Y47PZZFUXFW55AHB5WSIRHOSSLPZFNJTQSGLL5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL, address:145.79.227.14:4865): protocol: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection Sep 6 13:00:58.212576077 (190h52m54.892771646s) [noise=true , address=145.79.227.33:4878 , piece_id=C3U6RCAOUOIDZFVCOK3IBYUR2D3THF7S7XLN3UZSA3Z4LGGOCGNA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y, address:145.79.227.33:4878): protocol: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection Sep 6 13:00:58.212616413 (190h52m54.892811982s) [noise=true , address=145.79.227.5:4241 , piece_id=SY3CGY4QDPZJHP2FTMLJI7FY7VY3Y66BUZQNO65FE4BYSXS7YG5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR, address:145.79.227.5:4241): protocol: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection Sep 6 13:00:58.212624720 (190h52m54.892820289s) [noise=true , address=145.79.227.4:4197 , piece_id=HHJ4A63PZID3ZHQUD3OENTOIGXL6HY64YXJELF4JRLKQ7V3H36BA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1cB89C5xnya9WGD9dGBsSouqkZH3nLqytrg9Qo4UH2kdFonTjM, address:145.79.227.4:4197): protocol: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection Sep 6 13:00:58.212660899 (190h52m54.892856468s) [noise=true , address=77.90.31.18:4832 , piece_id=74UQB3G7FYNQFYGAS3SBLC6W7ECN7SSXQXF5N4PW3QSL3GJ3C7IA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12QnZ3q9oe4zPuLpS3V1DCBhyaU1umS5B7bpuAqPkaaY96ErWbo, address:77.90.31.18:4832): protocol: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection Sep 6 13:00:58.212689103 (190h52m54.892884672s) [noise=true , address=145.79.227.15:4892 , piece_id=HAMHVBFROPFJOMUGZBNGZ4BNMKWP375DRKXKHDI6BHIDOHRZN6KQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:145.79.227.15:4892): protocol: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection Sep 6 13:00:58.212702549 (190h52m54.892898118s) [noise=true , address=64.49.13.155:4923 , piece_id=C2NNEN5BWAWXCESYBELSDCP6PUXMLAS2I6YYFLYQ6CSCBOFYOBEQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z, address:64.49.13.155:4923): protocol: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection Sep 6 13:00:58.212734530 (190h52m54.892930099s) [noise=true , address=145.79.227.43:4176 , piece_id=ZDQ2VVCGVELEF7UFEY2B7WEOQGM4RWYKDJEC7ON7BTFQ7GLTIR7A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD, address:145.79.227.43:4176): protocol: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection Sep 6 13:00:58.212741814 (190h52m54.892937383s) [noise=true , address=145.79.227.11:4763 , piece_id=GMCGUDCCOSOAULHI25BSPCJANDXLZVWJTKTQ4SZH6ZKCPKYGMMWQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12P642GmVJzz139WqNE7AZFGieZUk1dNQPwEJ3RSeWVJ4xUZPuZ, address:145.79.227.11:4763): protocol: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection Sep 6 13:00:58.212795466 (190h52m54.892991036s) [noise=true , address=77.90.31.21:4910 , piece_id=6RNZHM6HLMOP66FNN6HWWOWKBALD452U6RQ5OSYFNYWI5H2NXAVQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12onFkiP1wSRcNuzyqegL2EjfttSrQ5AMJwfp9PBn5urHQb3C2H, address:77.90.31.21:4910): protocol: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection Sep 6 13:00:58.212816487 (190h52m54.893012056s) [noise=true , address=145.79.227.37:4583 , piece_id=F5HEKDV2VA7COUAI7L3O75BNBHWSTSKQJTXUFPBSYJLOEA5SBEIA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection Sep 6 13:00:58.212832727 (190h52m54.893028306s) [noise=true , address=77.90.31.10:4536 , piece_id=M5ZVVDRCCCZ6XFCY4FKRMXQPOH5BIGJCICAIO3O4GTCOJ7V4TB5Q, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen, address:77.90.31.10:4536): protocol: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection Sep 6 13:00:58.212842156 (190h52m54.893037725s) [noise=true , address=145.79.227.49:4342 , piece_id=HDZOVIFLOG7FRKHQETC3RAILZGZDCQVQRFVE3GVDZ7OOK53BLBEA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection Sep 6 13:00:58.212863476 (190h52m54.893059045s) [seg_pos={0 0}, upload=167835]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Sep 6 13:00:58.481431059 (190h52m55.161626638s) [upload=167835]: Done uploading segments... Sep 6 13:00:58.481462198 (190h52m55.161657797s) [upload=167835]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 11.264720348s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 7 out of 60 is failed (threshold=3) [......X...X....X............X..X..........X.....X...........] duration: 3.231996982s FAIL (2025-09-06 13:07:15 UTC) operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 48) Duration: 3.232022811s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 36 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.........] duration: 5.078562272s FAIL (2025-09-06 13:07:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 8) ======LOGS====== iece_id=MAPFBSPKCDEVIDXSGODTYSWR4HSDF3R6FWSEPLIZCQVZWRRIWT5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection Sep 6 13:00:45.733303268 (190h52m42.413498837s) [noise=true , address=185.167.204.206:4041 , piece_id=PJATWZNODOXWXL56LYPO3AMWFGRKLQNWQAWWFWHK4JI5PXHYXEPA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection Sep 6 13:00:45.733477351 (190h52m42.41367293s) [noise=true , address=185.167.204.205:4018 , piece_id=AXKSZN3HADHS3YT63O5PF5NBHNNR6CUUXAMCFRRROCHINERFQH5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.733526635 (190h52m42.413722204s) [noise=true , address=185.167.204.205:4034 , piece_id=FNRLEMKI64OP33HMR5C7ZH6LTVCH4PY2FHHINN44VL5CCUN5YJSQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: read tcp 188.166.225.170:48882->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.733771123 (190h52m42.413966692s) [noise=true , address=185.167.204.206:4053 , piece_id=HCWYRCASJ4HHD7KNL4LAIGM3NZTD2HBMJUCHNB6PNEP6VPY3456A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.734016713 (190h52m42.414212282s) [noise=true , address=185.167.204.205:4030 , piece_id=VKD6MXE6HP7GKWTJ7N75GIORGJNMIP3JNA2ELLG4UGFI5NQ3QQYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection Sep 6 13:00:45.734081286 (190h52m42.414276865s) [noise=true , address=185.167.204.206:4072 , piece_id=S4GSGX2V6DKN65XKFKQRP6VKC3FGMNX2TACNYFAQW3NAAABDDN4Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: read tcp 188.166.225.170:37318->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734144167 (190h52m42.414339746s) [noise=true , address=81.171.14.70:4031 , piece_id=N23GESXOXK7YN5NZCO6MR3YQEW63AEGZ2S7BZINDMSIGWBDW7C7A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection Sep 6 13:00:45.734225884 (190h52m42.414421453s) [noise=true , address=185.167.204.206:4050 , piece_id=KBKRVPSSNR3VXO4EUVASUFJXSKLXA7DNCRZ5ITKEFP5KIG6RXMKA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection Sep 6 13:00:45.734277362 (190h52m42.414472931s) [noise=true , address=185.167.204.205:4026 , piece_id=IFKAKMYEQ3XF7IZF2CVIONOABON6JDRTXHOQF6B6NTBWMUOBXWYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 188.166.225.170:59156->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734286389 (190h52m42.414481958s) [noise=true , address=185.167.204.205:4013 , piece_id=KFCOA7R77L3MKNXFSZXNI2CRLAAORK7AZSITMUVJXJJHLQUOZUAA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection Sep 6 13:00:45.734343248 (190h52m42.414538817s) [noise=true , address=185.167.204.205:4023 , piece_id=2HTXOAHW3RDHWLKH7VDEF27E2PGFNEZS7POOS5E7EMV6RNS25MLQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection Sep 6 13:00:45.734367104 (190h52m42.414562673s) [noise=true , address=185.167.204.206:4070 , piece_id=TM4G5XMOOKJQ5B2BY52QS7DZTUINDJRMKOYSEDHURPKSZQGPBBWA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection Sep 6 13:00:45.734410847 (190h52m42.414606416s) [noise=true , address=185.167.204.205:4020 , piece_id=A2NQE2NC5X2YI3GQAOAM4E2MRVPICXAU5VU2M3D6JI3X6PM2JWRQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection Sep 6 13:00:45.734443049 (190h52m42.414638618s) [noise=true , address=185.167.204.206:4054 , piece_id=JDNA5IDSNXNAH4REIYKZKNFHDKR7E3AWGJA7VEVI4NAPMYP5FZXA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection Sep 6 13:00:45.734461584 (190h52m42.414657153s) [noise=true , address=185.167.204.206:4052 , piece_id=NVOLPFSQA6EVOXY3KWBXCBTSUQEO4336TVXZ6BHD4KR76QV3RHIA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: read tcp 188.166.225.170:49118->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734474489 (190h52m42.414670058s) [noise=true , address=185.167.204.205:4032 , piece_id=7U5JZGQCNNGHNJBOPW4CCDE7JDLJNQXIHGZ3VQXNJYWPNVO5YDMA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection Sep 6 13:00:45.734518212 (190h52m42.414713792s) [seg_pos={0 0}, upload=167832]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil> Sep 6 13:00:45.907410026 (190h52m42.587605595s) [upload=167832]: Done uploading segments... Sep 6 13:00:45.907441366 (190h52m42.587636935s) [upload=167832]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8) Duration: 5.078587569s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 30 out of 60 is failed (threshold=3) [.................XXXXX.XX.XXXXXXXXXXXXXXXXXXXXXX.X..........] duration: 10.120220573s FAIL (2025-09-06 13:07:06 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 10.120254058s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 45 out of 60 is failed (threshold=3) [.....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..........] duration: 5.937136318s FAIL (2025-09-06 13:07:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.93717396s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [........................X.X.......X..XX.X.....X.............] duration: 736.609103ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 13:07:03 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": remote error: tls: internal error Duration: 736.639912ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.....XX.X.X.X...................X...XXX.....................] duration: 785.044136ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-09-06 13:06:58 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 785.075557ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 34 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..........] duration: 5.689737661s FAIL (2025-09-06 13:06:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.689764252s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 14 out of 60 is failed (threshold=3) [............XX.X....XXX..XX.....X.XX..X.X......X............] duration: 2.113373202s FAIL (2025-09-06 13:06:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:58:18.754471968 (190h50m15.434667537s) [upload=167816]: Starting upload Sep 6 12:58:18.754532594 (190h50m15.434728153s) [upload=167816]: Done starting upload Sep 6 12:58:18.754581738 (190h50m15.434777307s) [upload=167816]: Uploading segments... Sep 6 12:58:18.754616694 (190h50m15.434812263s) [upload=167816]: Got next segment. Inline: true Sep 6 12:58:18.754620623 (190h50m15.434816192s) [upload=167816]: Waiting for error group managing segments... Sep 6 12:58:18.754652033 (190h50m15.434847602s) [upload=167816]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 12:58:18.754657192 (190h50m15.434852761s) [upload=167816]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 12:58:18.754660459 (190h50m15.434856028s) [upload=167816]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 12:58:19.453677468 (190h50m16.133873047s) [upload=167816]: Done uploading segments... Sep 6 12:58:19.453698639 (190h50m16.133894208s) [upload=167816]: Upload finished. err: <nil> Duration:* 2.11340338s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 34 out of 60 is failed (threshold=3) [........XXXXXXX.X.XXXXXXXXXXXXXX....XXXX.XXXXXX...XX........] duration: 2.298589638s FAIL (2025-09-06 13:06:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.298610738s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 45 out of 60 is failed (threshold=3) [......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.........] duration: 5.946492961s FAIL (2025-09-06 13:06:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.946510205s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.........................X.X.......X..XX.X.....X............] duration: 744.674696ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 13:06:40 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": remote error: tls: internal error Duration: 744.701048ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 32 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.......] duration: 7.024582488s FAIL (2025-09-06 13:06:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== 0:32792->77.90.31.17:4796: use of closed network connection; write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection Sep 6 13:00:58.212486355 (190h52m54.892681924s) [noise=true , address=145.79.227.31:4825 , piece_id=57YANVBSITJTAZOJSCVVJLX4KGSFVY6QGLL3NXATT7YAXP5VILXQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12AYyhgZh7oAaGf4EXLSp6s1csFxCKfLuh6CJAPyzdC6pLQ51h, address:145.79.227.31:4825): protocol: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection Sep 6 13:00:58.212528175 (190h52m54.892723744s) [noise=true , address=77.90.31.13:4660 , piece_id=YNQXH3AAYLSUMJ5BLCVQVTTSZKMKAAUELBZ76Y4LQECLDADGOMSQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG, address:77.90.31.13:4660): protocol: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection Sep 6 13:00:58.212564826 (190h52m54.892760395s) [noise=true , address=145.79.227.14:4865 , piece_id=7LO6DCPQDVHY7Y47PZZFUXFW55AHB5WSIRHOSSLPZFNJTQSGLL5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL, address:145.79.227.14:4865): protocol: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection Sep 6 13:00:58.212576077 (190h52m54.892771646s) [noise=true , address=145.79.227.33:4878 , piece_id=C3U6RCAOUOIDZFVCOK3IBYUR2D3THF7S7XLN3UZSA3Z4LGGOCGNA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y, address:145.79.227.33:4878): protocol: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection Sep 6 13:00:58.212616413 (190h52m54.892811982s) [noise=true , address=145.79.227.5:4241 , piece_id=SY3CGY4QDPZJHP2FTMLJI7FY7VY3Y66BUZQNO65FE4BYSXS7YG5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR, address:145.79.227.5:4241): protocol: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection Sep 6 13:00:58.212624720 (190h52m54.892820289s) [noise=true , address=145.79.227.4:4197 , piece_id=HHJ4A63PZID3ZHQUD3OENTOIGXL6HY64YXJELF4JRLKQ7V3H36BA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1cB89C5xnya9WGD9dGBsSouqkZH3nLqytrg9Qo4UH2kdFonTjM, address:145.79.227.4:4197): protocol: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection Sep 6 13:00:58.212660899 (190h52m54.892856468s) [noise=true , address=77.90.31.18:4832 , piece_id=74UQB3G7FYNQFYGAS3SBLC6W7ECN7SSXQXF5N4PW3QSL3GJ3C7IA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12QnZ3q9oe4zPuLpS3V1DCBhyaU1umS5B7bpuAqPkaaY96ErWbo, address:77.90.31.18:4832): protocol: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection Sep 6 13:00:58.212689103 (190h52m54.892884672s) [noise=true , address=145.79.227.15:4892 , piece_id=HAMHVBFROPFJOMUGZBNGZ4BNMKWP375DRKXKHDI6BHIDOHRZN6KQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:145.79.227.15:4892): protocol: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection Sep 6 13:00:58.212702549 (190h52m54.892898118s) [noise=true , address=64.49.13.155:4923 , piece_id=C2NNEN5BWAWXCESYBELSDCP6PUXMLAS2I6YYFLYQ6CSCBOFYOBEQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z, address:64.49.13.155:4923): protocol: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection Sep 6 13:00:58.212734530 (190h52m54.892930099s) [noise=true , address=145.79.227.43:4176 , piece_id=ZDQ2VVCGVELEF7UFEY2B7WEOQGM4RWYKDJEC7ON7BTFQ7GLTIR7A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD, address:145.79.227.43:4176): protocol: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection Sep 6 13:00:58.212741814 (190h52m54.892937383s) [noise=true , address=145.79.227.11:4763 , piece_id=GMCGUDCCOSOAULHI25BSPCJANDXLZVWJTKTQ4SZH6ZKCPKYGMMWQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12P642GmVJzz139WqNE7AZFGieZUk1dNQPwEJ3RSeWVJ4xUZPuZ, address:145.79.227.11:4763): protocol: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection Sep 6 13:00:58.212795466 (190h52m54.892991036s) [noise=true , address=77.90.31.21:4910 , piece_id=6RNZHM6HLMOP66FNN6HWWOWKBALD452U6RQ5OSYFNYWI5H2NXAVQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12onFkiP1wSRcNuzyqegL2EjfttSrQ5AMJwfp9PBn5urHQb3C2H, address:77.90.31.21:4910): protocol: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection Sep 6 13:00:58.212816487 (190h52m54.893012056s) [noise=true , address=145.79.227.37:4583 , piece_id=F5HEKDV2VA7COUAI7L3O75BNBHWSTSKQJTXUFPBSYJLOEA5SBEIA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection Sep 6 13:00:58.212832727 (190h52m54.893028306s) [noise=true , address=77.90.31.10:4536 , piece_id=M5ZVVDRCCCZ6XFCY4FKRMXQPOH5BIGJCICAIO3O4GTCOJ7V4TB5Q, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen, address:77.90.31.10:4536): protocol: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection Sep 6 13:00:58.212842156 (190h52m54.893037725s) [noise=true , address=145.79.227.49:4342 , piece_id=HDZOVIFLOG7FRKHQETC3RAILZGZDCQVQRFVE3GVDZ7OOK53BLBEA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection Sep 6 13:00:58.212863476 (190h52m54.893059045s) [seg_pos={0 0}, upload=167835]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Sep 6 13:00:58.481431059 (190h52m55.161626638s) [upload=167835]: Done uploading segments... Sep 6 13:00:58.481462198 (190h52m55.161657797s) [upload=167835]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 7.02460902s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 36 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX........] duration: 5.182268475s FAIL (2025-09-06 13:06:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 8) ======LOGS====== iece_id=MAPFBSPKCDEVIDXSGODTYSWR4HSDF3R6FWSEPLIZCQVZWRRIWT5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection Sep 6 13:00:45.733303268 (190h52m42.413498837s) [noise=true , address=185.167.204.206:4041 , piece_id=PJATWZNODOXWXL56LYPO3AMWFGRKLQNWQAWWFWHK4JI5PXHYXEPA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection Sep 6 13:00:45.733477351 (190h52m42.41367293s) [noise=true , address=185.167.204.205:4018 , piece_id=AXKSZN3HADHS3YT63O5PF5NBHNNR6CUUXAMCFRRROCHINERFQH5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.733526635 (190h52m42.413722204s) [noise=true , address=185.167.204.205:4034 , piece_id=FNRLEMKI64OP33HMR5C7ZH6LTVCH4PY2FHHINN44VL5CCUN5YJSQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: read tcp 188.166.225.170:48882->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.733771123 (190h52m42.413966692s) [noise=true , address=185.167.204.206:4053 , piece_id=HCWYRCASJ4HHD7KNL4LAIGM3NZTD2HBMJUCHNB6PNEP6VPY3456A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.734016713 (190h52m42.414212282s) [noise=true , address=185.167.204.205:4030 , piece_id=VKD6MXE6HP7GKWTJ7N75GIORGJNMIP3JNA2ELLG4UGFI5NQ3QQYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection Sep 6 13:00:45.734081286 (190h52m42.414276865s) [noise=true , address=185.167.204.206:4072 , piece_id=S4GSGX2V6DKN65XKFKQRP6VKC3FGMNX2TACNYFAQW3NAAABDDN4Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: read tcp 188.166.225.170:37318->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734144167 (190h52m42.414339746s) [noise=true , address=81.171.14.70:4031 , piece_id=N23GESXOXK7YN5NZCO6MR3YQEW63AEGZ2S7BZINDMSIGWBDW7C7A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection Sep 6 13:00:45.734225884 (190h52m42.414421453s) [noise=true , address=185.167.204.206:4050 , piece_id=KBKRVPSSNR3VXO4EUVASUFJXSKLXA7DNCRZ5ITKEFP5KIG6RXMKA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection Sep 6 13:00:45.734277362 (190h52m42.414472931s) [noise=true , address=185.167.204.205:4026 , piece_id=IFKAKMYEQ3XF7IZF2CVIONOABON6JDRTXHOQF6B6NTBWMUOBXWYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 188.166.225.170:59156->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734286389 (190h52m42.414481958s) [noise=true , address=185.167.204.205:4013 , piece_id=KFCOA7R77L3MKNXFSZXNI2CRLAAORK7AZSITMUVJXJJHLQUOZUAA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection Sep 6 13:00:45.734343248 (190h52m42.414538817s) [noise=true , address=185.167.204.205:4023 , piece_id=2HTXOAHW3RDHWLKH7VDEF27E2PGFNEZS7POOS5E7EMV6RNS25MLQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection Sep 6 13:00:45.734367104 (190h52m42.414562673s) [noise=true , address=185.167.204.206:4070 , piece_id=TM4G5XMOOKJQ5B2BY52QS7DZTUINDJRMKOYSEDHURPKSZQGPBBWA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection Sep 6 13:00:45.734410847 (190h52m42.414606416s) [noise=true , address=185.167.204.205:4020 , piece_id=A2NQE2NC5X2YI3GQAOAM4E2MRVPICXAU5VU2M3D6JI3X6PM2JWRQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection Sep 6 13:00:45.734443049 (190h52m42.414638618s) [noise=true , address=185.167.204.206:4054 , piece_id=JDNA5IDSNXNAH4REIYKZKNFHDKR7E3AWGJA7VEVI4NAPMYP5FZXA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection Sep 6 13:00:45.734461584 (190h52m42.414657153s) [noise=true , address=185.167.204.206:4052 , piece_id=NVOLPFSQA6EVOXY3KWBXCBTSUQEO4336TVXZ6BHD4KR76QV3RHIA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: read tcp 188.166.225.170:49118->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734474489 (190h52m42.414670058s) [noise=true , address=185.167.204.205:4032 , piece_id=7U5JZGQCNNGHNJBOPW4CCDE7JDLJNQXIHGZ3VQXNJYWPNVO5YDMA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection Sep 6 13:00:45.734518212 (190h52m42.414713792s) [seg_pos={0 0}, upload=167832]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil> Sep 6 13:00:45.907410026 (190h52m42.587605595s) [upload=167832]: Done uploading segments... Sep 6 13:00:45.907441366 (190h52m42.587636935s) [upload=167832]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8) Duration: 5.18229216s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 23 out of 60 is failed (threshold=3) [.........X.XX.XXX.XXXX....XXX..X.X.....X.XX.X...XXXX........] duration: 3.510180275s FAIL (2025-09-06 13:06:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 13:00:21.385451159 (190h52m18.065646759s) [upload=167839]: Starting upload Sep 6 13:00:21.385573654 (190h52m18.065769233s) [upload=167839]: Done starting upload Sep 6 13:00:21.385682032 (190h52m18.065877601s) [upload=167839]: Uploading segments... Sep 6 13:00:21.385790509 (190h52m18.065986078s) [upload=167839]: Got next segment. Inline: true Sep 6 13:00:21.385820957 (190h52m18.066016527s) [upload=167839]: Waiting for error group managing segments... Sep 6 13:00:21.385871655 (190h52m18.066067224s) [upload=167839]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 13:00:21.385876985 (190h52m18.066072554s) [upload=167839]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 13:00:21.385880070 (190h52m18.066075639s) [upload=167839]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 13:00:23.550369185 (190h52m20.230564764s) [upload=167839]: Done uploading segments... Sep 6 13:00:23.550388793 (190h52m20.230584362s) [upload=167839]: Upload finished. err: <nil> Duration:* 3.510201645s core uplink us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 5 out of 60 is failed (threshold=3) [..XX.......X......X..............X..........................] duration: 499.107727ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 13:06:36 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 499.121303ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 34 out of 60 is failed (threshold=3) [.........XXXXXXX.X.XXXXXXXXXXXXXX....XXXX.XXXXXX...XX.......] duration: 2.538694096s FAIL (2025-09-06 13:06:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.53871647s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 34 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.........] duration: 5.553172661s FAIL (2025-09-06 13:06:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.553213128s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..........X......X..XXXX.....X.......XX...X.....X...........] duration: 5.326438073s FAIL (2025-09-06 13:06:29 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 5.326464644s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [......XX.X.X.X...................X...XXX....................] duration: 1.798953802s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-09-06 13:06:27 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 1.79898401s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 26 out of 60 is failed (threshold=3) [.....XXXXXX..X....XX.X..X.XX..XXXXX.X...XXX..XX.XX..........] duration: 2.417561221s FAIL (2025-09-06 13:06:26 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.417588652s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 30 out of 60 is failed (threshold=3) [..................XXXXX.XX.XXXXXXXXXXXXXXXXXXXXXX.X.........] duration: 7.324689741s FAIL (2025-09-06 13:06:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 7.324714991s core uplink us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [................X..X........X...........X.........X.........] duration: 754.180848ms FAIL (2025-09-06 13:06:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 754.221857ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 14 out of 60 is failed (threshold=3) [.............XX.X....XXX..XX.....X.XX..X.X......X...........] duration: 2.19100389s FAIL (2025-09-06 13:06:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:58:18.754471968 (190h50m15.434667537s) [upload=167816]: Starting upload Sep 6 12:58:18.754532594 (190h50m15.434728153s) [upload=167816]: Done starting upload Sep 6 12:58:18.754581738 (190h50m15.434777307s) [upload=167816]: Uploading segments... Sep 6 12:58:18.754616694 (190h50m15.434812263s) [upload=167816]: Got next segment. Inline: true Sep 6 12:58:18.754620623 (190h50m15.434816192s) [upload=167816]: Waiting for error group managing segments... Sep 6 12:58:18.754652033 (190h50m15.434847602s) [upload=167816]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 12:58:18.754657192 (190h50m15.434852761s) [upload=167816]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 12:58:18.754660459 (190h50m15.434856028s) [upload=167816]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 12:58:19.453677468 (190h50m16.133873047s) [upload=167816]: Done uploading segments... Sep 6 12:58:19.453698639 (190h50m16.133894208s) [upload=167816]: Upload finished. err: <nil> Duration:* 2.191027536s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 32 out of 60 is failed (threshold=3) [......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX......] duration: 10.355129489s FAIL (2025-09-06 13:06:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== 0:32792->77.90.31.17:4796: use of closed network connection; write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32792->77.90.31.17:4796: use of closed network connection Sep 6 13:00:58.212486355 (190h52m54.892681924s) [noise=true , address=145.79.227.31:4825 , piece_id=57YANVBSITJTAZOJSCVVJLX4KGSFVY6QGLL3NXATT7YAXP5VILXQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12AYyhgZh7oAaGf4EXLSp6s1csFxCKfLuh6CJAPyzdC6pLQ51h, address:145.79.227.31:4825): protocol: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->145.79.227.31:4825: use of closed network connection Sep 6 13:00:58.212528175 (190h52m54.892723744s) [noise=true , address=77.90.31.13:4660 , piece_id=YNQXH3AAYLSUMJ5BLCVQVTTSZKMKAAUELBZ76Y4LQECLDADGOMSQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG, address:77.90.31.13:4660): protocol: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34676->77.90.31.13:4660: use of closed network connection Sep 6 13:00:58.212564826 (190h52m54.892760395s) [noise=true , address=145.79.227.14:4865 , piece_id=7LO6DCPQDVHY7Y47PZZFUXFW55AHB5WSIRHOSSLPZFNJTQSGLL5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL, address:145.79.227.14:4865): protocol: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39472->145.79.227.14:4865: use of closed network connection Sep 6 13:00:58.212576077 (190h52m54.892771646s) [noise=true , address=145.79.227.33:4878 , piece_id=C3U6RCAOUOIDZFVCOK3IBYUR2D3THF7S7XLN3UZSA3Z4LGGOCGNA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y, address:145.79.227.33:4878): protocol: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42510->145.79.227.33:4878: use of closed network connection Sep 6 13:00:58.212616413 (190h52m54.892811982s) [noise=true , address=145.79.227.5:4241 , piece_id=SY3CGY4QDPZJHP2FTMLJI7FY7VY3Y66BUZQNO65FE4BYSXS7YG5A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR, address:145.79.227.5:4241): protocol: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48122->145.79.227.5:4241: use of closed network connection Sep 6 13:00:58.212624720 (190h52m54.892820289s) [noise=true , address=145.79.227.4:4197 , piece_id=HHJ4A63PZID3ZHQUD3OENTOIGXL6HY64YXJELF4JRLKQ7V3H36BA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1cB89C5xnya9WGD9dGBsSouqkZH3nLqytrg9Qo4UH2kdFonTjM, address:145.79.227.4:4197): protocol: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40478->145.79.227.4:4197: use of closed network connection Sep 6 13:00:58.212660899 (190h52m54.892856468s) [noise=true , address=77.90.31.18:4832 , piece_id=74UQB3G7FYNQFYGAS3SBLC6W7ECN7SSXQXF5N4PW3QSL3GJ3C7IA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12QnZ3q9oe4zPuLpS3V1DCBhyaU1umS5B7bpuAqPkaaY96ErWbo, address:77.90.31.18:4832): protocol: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43620->77.90.31.18:4832: use of closed network connection Sep 6 13:00:58.212689103 (190h52m54.892884672s) [noise=true , address=145.79.227.15:4892 , piece_id=HAMHVBFROPFJOMUGZBNGZ4BNMKWP375DRKXKHDI6BHIDOHRZN6KQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:145.79.227.15:4892): protocol: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42620->145.79.227.15:4892: use of closed network connection Sep 6 13:00:58.212702549 (190h52m54.892898118s) [noise=true , address=64.49.13.155:4923 , piece_id=C2NNEN5BWAWXCESYBELSDCP6PUXMLAS2I6YYFLYQ6CSCBOFYOBEQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z, address:64.49.13.155:4923): protocol: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41350->64.49.13.155:4923: use of closed network connection Sep 6 13:00:58.212734530 (190h52m54.892930099s) [noise=true , address=145.79.227.43:4176 , piece_id=ZDQ2VVCGVELEF7UFEY2B7WEOQGM4RWYKDJEC7ON7BTFQ7GLTIR7A, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD, address:145.79.227.43:4176): protocol: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40838->145.79.227.43:4176: use of closed network connection Sep 6 13:00:58.212741814 (190h52m54.892937383s) [noise=true , address=145.79.227.11:4763 , piece_id=GMCGUDCCOSOAULHI25BSPCJANDXLZVWJTKTQ4SZH6ZKCPKYGMMWQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12P642GmVJzz139WqNE7AZFGieZUk1dNQPwEJ3RSeWVJ4xUZPuZ, address:145.79.227.11:4763): protocol: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37170->145.79.227.11:4763: use of closed network connection Sep 6 13:00:58.212795466 (190h52m54.892991036s) [noise=true , address=77.90.31.21:4910 , piece_id=6RNZHM6HLMOP66FNN6HWWOWKBALD452U6RQ5OSYFNYWI5H2NXAVQ, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:12onFkiP1wSRcNuzyqegL2EjfttSrQ5AMJwfp9PBn5urHQb3C2H, address:77.90.31.21:4910): protocol: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48842->77.90.31.21:4910: use of closed network connection Sep 6 13:00:58.212816487 (190h52m54.893012056s) [noise=true , address=145.79.227.37:4583 , piece_id=F5HEKDV2VA7COUAI7L3O75BNBHWSTSKQJTXUFPBSYJLOEA5SBEIA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.37:4583: use of closed network connection Sep 6 13:00:58.212832727 (190h52m54.893028306s) [noise=true , address=77.90.31.10:4536 , piece_id=M5ZVVDRCCCZ6XFCY4FKRMXQPOH5BIGJCICAIO3O4GTCOJ7V4TB5Q, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen, address:77.90.31.10:4536): protocol: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58188->77.90.31.10:4536: use of closed network connection Sep 6 13:00:58.212842156 (190h52m54.893037725s) [noise=true , address=145.79.227.49:4342 , piece_id=HDZOVIFLOG7FRKHQETC3RAILZGZDCQVQRFVE3GVDZ7OOK53BLBEA, seg_pos={0 0}, upload=167835]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->145.79.227.49:4342: use of closed network connection Sep 6 13:00:58.212863476 (190h52m54.893059045s) [seg_pos={0 0}, upload=167835]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Sep 6 13:00:58.481431059 (190h52m55.161626638s) [upload=167835]: Done uploading segments... Sep 6 13:00:58.481462198 (190h52m55.161657797s) [upload=167835]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 10.35514644s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 45 out of 60 is failed (threshold=3) [.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX........] duration: 6.218402358s FAIL (2025-09-06 13:06:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.218427916s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 44 out of 60 is failed (threshold=3) [...X.....X.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.......] duration: 9.130730254s FAIL (2025-09-06 13:06:11 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 9.130757015s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 34 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX........] duration: 5.722123133s FAIL (2025-09-06 13:06:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.722139723s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 23 out of 60 is failed (threshold=3) [..........X.XX.XXX.XXXX....XXX..X.X.....X.XX.X...XXXX.......] duration: 2.307533444s FAIL (2025-09-06 13:06:06 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 13:00:21.385451159 (190h52m18.065646759s) [upload=167839]: Starting upload Sep 6 13:00:21.385573654 (190h52m18.065769233s) [upload=167839]: Done starting upload Sep 6 13:00:21.385682032 (190h52m18.065877601s) [upload=167839]: Uploading segments... Sep 6 13:00:21.385790509 (190h52m18.065986078s) [upload=167839]: Got next segment. Inline: true Sep 6 13:00:21.385820957 (190h52m18.066016527s) [upload=167839]: Waiting for error group managing segments... Sep 6 13:00:21.385871655 (190h52m18.066067224s) [upload=167839]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 13:00:21.385876985 (190h52m18.066072554s) [upload=167839]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 13:00:21.385880070 (190h52m18.066075639s) [upload=167839]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 13:00:23.550369185 (190h52m20.230564764s) [upload=167839]: Done uploading segments... Sep 6 13:00:23.550388793 (190h52m20.230584362s) [upload=167839]: Upload finished. err: <nil> Duration:* 2.307561888s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 7 out of 60 is failed (threshold=3) [.......X...X....X............X..X..........X.....X..........] duration: 3.328375164s FAIL (2025-09-06 13:06:03 UTC) operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 48) Duration: 3.328395824s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [..........................X.X.......X..XX.X.....X...........] duration: 732.524748ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 13:06:03 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": remote error: tls: internal error Duration: 732.54614ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 36 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.......] duration: 5.064670789s FAIL (2025-09-06 13:06:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 8) ======LOGS====== iece_id=MAPFBSPKCDEVIDXSGODTYSWR4HSDF3R6FWSEPLIZCQVZWRRIWT5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59656->185.167.204.205:4029: use of closed network connection Sep 6 13:00:45.733303268 (190h52m42.413498837s) [noise=true , address=185.167.204.206:4041 , piece_id=PJATWZNODOXWXL56LYPO3AMWFGRKLQNWQAWWFWHK4JI5PXHYXEPA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35812->185.167.204.206:4041: use of closed network connection Sep 6 13:00:45.733477351 (190h52m42.41367293s) [noise=true , address=185.167.204.205:4018 , piece_id=AXKSZN3HADHS3YT63O5PF5NBHNNR6CUUXAMCFRRROCHINERFQH5Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.733526635 (190h52m42.413722204s) [noise=true , address=185.167.204.205:4034 , piece_id=FNRLEMKI64OP33HMR5C7ZH6LTVCH4PY2FHHINN44VL5CCUN5YJSQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: read tcp 188.166.225.170:48882->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.733771123 (190h52m42.413966692s) [noise=true , address=185.167.204.206:4053 , piece_id=HCWYRCASJ4HHD7KNL4LAIGM3NZTD2HBMJUCHNB6PNEP6VPY3456A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 13:00:45.734016713 (190h52m42.414212282s) [noise=true , address=185.167.204.205:4030 , piece_id=VKD6MXE6HP7GKWTJ7N75GIORGJNMIP3JNA2ELLG4UGFI5NQ3QQYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35068->185.167.204.205:4030: use of closed network connection Sep 6 13:00:45.734081286 (190h52m42.414276865s) [noise=true , address=185.167.204.206:4072 , piece_id=S4GSGX2V6DKN65XKFKQRP6VKC3FGMNX2TACNYFAQW3NAAABDDN4Q, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: read tcp 188.166.225.170:37318->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734144167 (190h52m42.414339746s) [noise=true , address=81.171.14.70:4031 , piece_id=N23GESXOXK7YN5NZCO6MR3YQEW63AEGZ2S7BZINDMSIGWBDW7C7A, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40750->81.171.14.70:4031: use of closed network connection Sep 6 13:00:45.734225884 (190h52m42.414421453s) [noise=true , address=185.167.204.206:4050 , piece_id=KBKRVPSSNR3VXO4EUVASUFJXSKLXA7DNCRZ5ITKEFP5KIG6RXMKA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55570->185.167.204.206:4050: use of closed network connection Sep 6 13:00:45.734277362 (190h52m42.414472931s) [noise=true , address=185.167.204.205:4026 , piece_id=IFKAKMYEQ3XF7IZF2CVIONOABON6JDRTXHOQF6B6NTBWMUOBXWYA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 188.166.225.170:59156->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734286389 (190h52m42.414481958s) [noise=true , address=185.167.204.205:4013 , piece_id=KFCOA7R77L3MKNXFSZXNI2CRLAAORK7AZSITMUVJXJJHLQUOZUAA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38914->185.167.204.205:4013: use of closed network connection Sep 6 13:00:45.734343248 (190h52m42.414538817s) [noise=true , address=185.167.204.205:4023 , piece_id=2HTXOAHW3RDHWLKH7VDEF27E2PGFNEZS7POOS5E7EMV6RNS25MLQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37952->185.167.204.205:4023: use of closed network connection Sep 6 13:00:45.734367104 (190h52m42.414562673s) [noise=true , address=185.167.204.206:4070 , piece_id=TM4G5XMOOKJQ5B2BY52QS7DZTUINDJRMKOYSEDHURPKSZQGPBBWA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56934->185.167.204.206:4070: use of closed network connection Sep 6 13:00:45.734410847 (190h52m42.414606416s) [noise=true , address=185.167.204.205:4020 , piece_id=A2NQE2NC5X2YI3GQAOAM4E2MRVPICXAU5VU2M3D6JI3X6PM2JWRQ, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55944->185.167.204.205:4020: use of closed network connection Sep 6 13:00:45.734443049 (190h52m42.414638618s) [noise=true , address=185.167.204.206:4054 , piece_id=JDNA5IDSNXNAH4REIYKZKNFHDKR7E3AWGJA7VEVI4NAPMYP5FZXA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50528->185.167.204.206:4054: use of closed network connection Sep 6 13:00:45.734461584 (190h52m42.414657153s) [noise=true , address=185.167.204.206:4052 , piece_id=NVOLPFSQA6EVOXY3KWBXCBTSUQEO4336TVXZ6BHD4KR76QV3RHIA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: read tcp 188.166.225.170:49118->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 13:00:45.734474489 (190h52m42.414670058s) [noise=true , address=185.167.204.205:4032 , piece_id=7U5JZGQCNNGHNJBOPW4CCDE7JDLJNQXIHGZ3VQXNJYWPNVO5YDMA, seg_pos={0 0}, upload=167832]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40134->185.167.204.205:4032: use of closed network connection Sep 6 13:00:45.734518212 (190h52m42.414713792s) [seg_pos={0 0}, upload=167832]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil> Sep 6 13:00:45.907410026 (190h52m42.587605595s) [upload=167832]: Done uploading segments... Sep 6 13:00:45.907441366 (190h52m42.587636935s) [upload=167832]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8) Duration: 5.064690185s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 30 out of 60 is failed (threshold=3) [...................XXXXX.XX.XXXXXXXXXXXXXXXXXXXXXX.X........] duration: 7.850237383s FAIL (2025-09-06 13:05:56 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 7.850275716s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.......XX.X.X.X...................X...XXX...................] duration: 762.853103ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-09-06 13:05:48 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 762.876818ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...........X......X..XXXX.....X.......XX...X.....X..........] duration: 5.30290105s FAIL (2025-09-06 13:05:43 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 5.302933912s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 26 out of 60 is failed (threshold=3) [......XXXXXX..X....XX.X..X.XX..XXXXX.X...XXX..XX.XX.........] duration: 3.314804286s FAIL (2025-09-06 13:05:37 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 3.314872697s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)