Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
10 out of 60 is failed (threshold=3) [...............................................X.XX.XXX.XXXX] duration:
30.000270121s
FAIL (2025-09-06 12:36:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:36:46.135515460 (190h28m42.815711029s) [upload=167557]: Starting upload Sep 6 12:36:46.135651961 (190h28m42.81584753s) [upload=167557]: Done starting upload Sep 6 12:36:46.135711044 (190h28m42.815906613s) [upload=167557]: Uploading segments... Sep 6 12:36:46.135765809 (190h28m42.815961378s) [upload=167557]: Got next segment. Inline: true Sep 6 12:36:46.135770968 (190h28m42.815966537s) [upload=167557]: Waiting for error group managing segments... Sep 6 12:36:46.135808270 (190h28m42.816003839s) [upload=167557]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:36:46.135812508 (190h28m42.816008077s) [upload=167557]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Sep 6 12:36:46.135815023 (190h28m42.816010592s) [upload=167557]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Sep 6 12:36:50.882499530 (190h28m47.562695099s) [upload=167557]: Done uploading segments... Sep 6 12:36:50.882515481 (190h28m47.56271105s) [upload=167557]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000287564s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................................................XXXXX.] duration:
19.86273752s
FAIL (2025-09-06 12:36:46 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 19.862754973s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................................X...X....X...] duration:
4.27063476s
FAIL (2025-09-06 12:36:43 UTC)
operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47)
Duration: 4.270660188s
core
uplink
ap1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.............................................XX.......X.....] duration:
1.872072411s remote:
"tcp:45.38.24.2:80" target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 12:36:38 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded
Duration: 1.872092168s
edge
linksharing
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [................................................X..X........] duration:
44.025898921s
FAIL (2025-09-06 12:36:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 44.025946402s
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................................X......X..XX] duration:
30.178953347s
FAIL (2025-09-06 12:36:35 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 48)
Duration: 30.178969469s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
14 out of 60 is failed (threshold=3) [............................................XXXXXXX.X.XXXXXX] duration:
30.000239623s
FAIL (2025-09-06 12:36:34 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.000256616s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
6 out of 60 is failed (threshold=3) [...............................................XX.X....XXX..] duration:
18.371179985s
FAIL (2025-09-06 12:36:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:34:19.488654703 (190h26m16.168850332s) [upload=167526]: Starting upload Sep 6 12:34:19.488762580 (190h26m16.168958179s) [upload=167526]: Done starting upload Sep 6 12:34:19.488845679 (190h26m16.169041268s) [upload=167526]: Uploading segments... Sep 6 12:34:19.488896575 (190h26m16.169092144s) [upload=167526]: Got next segment. Inline: true Sep 6 12:34:19.488903429 (190h26m16.169098998s) [upload=167526]: Waiting for error group managing segments... Sep 6 12:34:19.488954346 (190h26m16.169149966s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:34:19.488960999 (190h26m16.169156608s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Sep 6 12:34:19.488965277 (190h26m16.169160866s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Sep 6 12:34:44.617583662 (190h26m41.297779281s) [upload=167526]: Done uploading segments... Sep 6 12:34:44.617605544 (190h26m41.297801103s) [upload=167526]: Upload finished. err: <nil>
Duration: 18.371217527s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
8 out of 60 is failed (threshold=3) [..............................................XXXXXX..X....X] duration:
30.000821717s
FAIL (2025-09-06 12:36:29 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.000844651s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration:
1m0.001487464s
FAIL (2025-09-06 12:36:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 6 12:36:25.982899809 (190h28m22.663095378s) [upload=167550]: Starting upload Sep 6 12:36:25.982967869 (190h28m22.663163438s) [upload=167550]: Done starting upload Sep 6 12:36:25.983132965 (190h28m22.663328524s) [upload=167550]: Uploading segments... Sep 6 12:36:25.983284325 (190h28m22.663479904s) [upload=167550]: Got next segment. Inline: false Sep 6 12:36:25.983367013 (190h28m22.663562582s) [upload=167550]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:36:25.983372884 (190h28m22.663568453s) [upload=167550]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Sep 6 12:36:27.676086078 (190h28m24.356281647s) [upload=167550]: Next segment err: context deadline exceeded Sep 6 12:36:27.676195557 (190h28m24.356391126s) [upload=167550]: Done uploading segments... Sep 6 12:36:27.676210425 (190h28m24.356405994s) [upload=167550]: Upload finished. err: context deadline exceeded
Duration: 1m0.00150054s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration:
6m33.694632632s
FAIL (2025-09-06 12:36:26 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6m33.694646087s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000688412s target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-09-06 12:36:23 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.000714131s
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration:
30.000725813s
FAIL (2025-09-06 12:36:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000746112s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
21 out of 60 is failed (threshold=3) [.....X......................X......X.....X.XXXXXXXXXXXXXXXXX] duration:
30.000840682s
FAIL (2025-09-06 12:36:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 6 12:35:53.693534629 (190h27m50.373730198s) [upload=167543]: Starting upload Sep 6 12:35:53.693596898 (190h27m50.373792467s) [upload=167543]: Done starting upload Sep 6 12:35:53.693697541 (190h27m50.37389313s) [upload=167543]: Uploading segments... Sep 6 12:35:53.693840635 (190h27m50.374036204s) [upload=167543]: Got next segment. Inline: false Sep 6 12:35:53.693884699 (190h27m50.374080269s) [upload=167543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:35:53.693898395 (190h27m50.374093964s) [upload=167543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Sep 6 12:36:20.887903748 (190h28m17.568099317s) [upload=167543]: Next segment err: context deadline exceeded Sep 6 12:36:20.887987318 (190h28m17.568182887s) [upload=167543]: Done uploading segments... Sep 6 12:36:20.888000101 (190h28m17.568195671s) [upload=167543]: Upload finished. err: context deadline exceeded
Duration: 30.000854919s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
9 out of 60 is failed (threshold=3) [................................................X.XX.XXX.XXX] duration:
30.001116832s
FAIL (2025-09-06 12:36:20 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 30.001167459s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration:
1m0.175707791s
FAIL (2025-09-06 12:36:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 4)
======LOGS======
089366 (190h28m15.168284935s) [noise=true , address=81.171.14.70:4026 , piece_id=FW5PXPTLNHJ45MFZ362EG3VMO3GVMII5DX6NJEJYUYVW722NFAEQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:55034->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:55034->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55034->81.171.14.70:4026: use of closed network connection
Sep 6 12:36:18.488123862 (190h28m15.168319431s) [noise=true , address=81.171.14.70:4034 , piece_id=U3EMCH2MIW5EFJHSJE4NOWRL2N5KCVQJ5I3ITHIRHQBH4PJF7D2A, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:42336->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488218542 (190h28m15.168414111s) [noise=true , address=185.167.204.206:4041 , piece_id=PRZ4GB2QKKVHNUN6BCMQOLZVPQGP43OAK5UIO4PUYSNO2LB7TDRQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: read tcp 188.166.225.170:59938->185.167.204.206:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488291462 (190h28m15.168487031s) [noise=true , address=185.167.204.206:4058 , piece_id=AR56RC6J5A7X4A7CW7W6PLFJBOZAOH6UDQOEBXFIW4DYDUIQDVKA, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: read tcp 188.166.225.170:39344->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488358650 (190h28m15.168554219s) [noise=true , address=81.171.14.70:4033 , piece_id=LCNQKBXHHKL3PEIYPQ5DN7DQ6OGBAKPNG3GVSYTAXNSO4I6QPUJA, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:42484->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488377557 (190h28m15.168573126s) [noise=true , address=185.167.204.205:4003 , piece_id=76E3IAVOZJCMMEZP754VDBBGQVPOY5DYGI24EUFRVTPRWZC5GNMA, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: read tcp 188.166.225.170:50190->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488399489 (190h28m15.168595058s) [noise=true , address=185.167.204.205:4011 , piece_id=JECFDMFQABRQNHK524QQNRPY7WNLJEEI3XCCSTFX4D7WT2QF4DOQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: read tcp 188.166.225.170:40476->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488436319 (190h28m15.168631888s) [noise=true , address=81.171.14.70:4030 , piece_id=MDZHVYRKJG6N6J7RJBL236P2QRUBDAZV4Z372P5NU4A2OLNG253A, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: read tcp 188.166.225.170:55850->81.171.14.70:4030: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488450597 (190h28m15.168646166s) [noise=true , address=185.167.204.205:4034 , piece_id=GKZSFUJB25RDNQLWRF3N7BZIK2FDWJW4XR3ZVDJEUYKUQ7WQQHAA, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:46194->185.167.204.205:4034: use of closed network connection; write tcp 188.166.225.170:46194->185.167.204.205:4034: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46194->185.167.204.205:4034: use of closed network connection
Sep 6 12:36:18.488467398 (190h28m15.168662958s) [noise=true , address=185.167.204.205:4028 , piece_id=LQPUMOH253D6AHKU7YTVZXX3N7MQBLVGCIE5K5AQZ5EURCA2ZEXA, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: read tcp 188.166.225.170:47804->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488496304 (190h28m15.168691873s) [noise=true , address=185.167.204.206:4043 , piece_id=7IE5KQRYXLMKBPWD6MCR3HTXEEJ52OAQURFMCICXH3BGZ7TTDURA, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: read tcp 188.166.225.170:40858->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488525260 (190h28m15.168720829s) [noise=true , address=185.167.204.206:4057 , piece_id=QWRV5EEXO2MIEWINEMJQXZAWDQAJWBDWOYNUAJFP72MSP2B4LA6A, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: write tcp 188.166.225.170:52382->185.167.204.206:4057: use of closed network connection; write tcp 188.166.225.170:52382->185.167.204.206:4057: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52382->185.167.204.206:4057: use of closed network connection
Sep 6 12:36:18.488563353 (190h28m15.168758922s) [noise=true , address=185.167.204.205:4029 , piece_id=WMCRIYZ5SF34SOPLCODRBZBVXMNBFAVLH2ONKKTQ2AAS4HBU5QFQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:32964->185.167.204.205:4029: use of closed network connection; write tcp 188.166.225.170:32964->185.167.204.205:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32964->185.167.204.205:4029: use of closed network connection
Sep 6 12:36:18.488600323 (190h28m15.168795892s) [noise=true , address=81.171.14.70:4037 , piece_id=FG6U5PB3B76OAOYEPF6RGHIBKIG5AQXV6KW4YQU2YAUIY5CFK5PA, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:53106->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:53106->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53106->81.171.14.70:4037: use of closed network connection
Sep 6 12:36:18.488692620 (190h28m15.168888189s) [noise=true , address=185.167.204.206:4055 , piece_id=FEZWIXUTR2NH4WULOW6A3NSSPW5XTTXHSA3C4O6E4DQISCUMAIBQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: write tcp 188.166.225.170:55508->185.167.204.206:4055: use of closed network connection; write tcp 188.166.225.170:55508->185.167.204.206:4055: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55508->185.167.204.206:4055: use of closed network connection
Sep 6 12:36:18.488727056 (190h28m15.168922625s) [noise=true , address=185.167.204.205:4002 , piece_id=TV6YU5WSIMCHNWIZ7KKM2J544HHDV326YZPXAZKIS4C5RT5QRLXQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: read tcp 188.166.225.170:45646->185.167.204.205:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488741002 (190h28m15.168936571s) [noise=true , address=81.171.14.70:4035 , piece_id=AB3JMZ2MMGZS2KR35U56PIDIRHVO5OSUDAHFRDX3RY43P2DCRWJQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: read tcp 188.166.225.170:37230->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488745141 (190h28m15.16894071s) [noise=true , address=185.167.204.205:4015 , piece_id=ADNEYAL5FH2MQ32UGU4FNUPZZTRW3WNFB2LZIWJZVTUZKLY5H3SQ, seg_pos={0 0}, upload=167535]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 188.166.225.170:37454->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:36:18.488802741 (190h28m15.16899832s) [seg_pos={0 0}, upload=167535]: Done waiting for segment. successful: 4 optimal: 26 errs: <nil>
Sep 6 12:36:18.660543541 (190h28m15.340739171s) [upload=167535]: Done uploading segments...
Sep 6 12:36:18.660577326 (190h28m15.340772925s) [upload=167535]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 4)
Duration: 1m0.175727188s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration:
1m0.00085325s
FAIL (2025-09-06 12:36:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000865203s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................................X...X....X..] duration:
3.269610609s
FAIL (2025-09-06 12:36:05 UTC)
operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47)
Duration: 3.269643923s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................................X......X..X] duration:
30.180061867s
FAIL (2025-09-06 12:36:04 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 43)
Duration: 30.18008425s
core
uplink
eu1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [..............................................XX.......X....] duration:
6.255693043s remote:
"tcp:45.38.24.2:80" target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 12:35:54 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded
Duration: 6.255721438s
edge
linksharing
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [......X......................X......X.....X.XXXXXXXXXXXXXXXX] duration:
30.4730653s
FAIL (2025-09-06 12:35:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
38]: Uploading piece...
Sep 6 12:35:29.979375439 (190h27m26.659571008s) [noise=true , address=45.91.116.13:4154 , piece_id=V7QAO5JQYCYOH7JPOQFMGQHJANO4GPDJFKZFCWSRUPMLYOOCMQOQ, seg_pos={0 0}, upload=167538]: Uploading piece...
Sep 6 12:35:29.979382031 (190h27m26.6595776s) [noise=true , address=45.91.116.11:4117 , piece_id=QPVZJOOJZB37G5V5PAAQ7CVHKO25UO4DRGWXP4WNOV5S27NFED4Q, seg_pos={0 0}, upload=167538]: Uploading piece...
Sep 6 12:35:29.979674711 (190h27m26.65987028s) [noise=true , address=45.91.116.10:4081 , piece_id=RWTCPF542QFPF7NJTMUFUNMLCJMRCNJTWPQAEJ4HV5VTJ6ODAA4A, seg_pos={0 0}, upload=167538]: Uploading piece...
Sep 6 12:35:29.979920802 (190h27m26.660116371s) [noise=true , address=45.91.116.8:4047 , piece_id=4BXPRGLDN3OOJE7V6FSBTIYZCO6BRHKFVXGPF33PXHJMI5VPZYYA, seg_pos={0 0}, upload=167538]: Uploading piece...
Sep 6 12:35:29.980170390 (190h27m26.660365959s) [noise=true , address=45.91.116.12:4225 , piece_id=K7PD4DNPQ6NQIPH5KA3GVO2E6QRFTEMCDC3PUK5QSKIMNKIRS4KA, seg_pos={0 0}, upload=167538]: Uploading piece...
Sep 6 12:35:29.980453491 (190h27m26.66064906s) [noise=true , address=45.91.116.13:4155 , piece_id=IU3QP6LPIUC2U7SZLT46QQX7SXDYRLT4L5O7YBKZMVUYC7AHF2HQ, seg_pos={0 0}, upload=167538]: Uploading piece...
Sep 6 12:35:29.982926915 (190h27m26.663122484s) [noise=true , address=45.91.116.4:4939 , piece_id=KEH2V4EHIHP7QWJBZJSD7PMBHPGFPXENQP2BZ2OTCLNCVGPFAC5A, seg_pos={0 0}, upload=167538]: Uploading piece...
Sep 6 12:35:50.154166603 (190h27m46.834362172s) [upload=167538]: Next segment err: context deadline exceeded
Sep 6 12:35:50.154670848 (190h27m46.834866417s) [noise=true , address=45.91.116.10:4081 , piece_id=RWTCPF542QFPF7NJTMUFUNMLCJMRCNJTWPQAEJ4HV5VTJ6ODAA4A, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:51434->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:51434->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51434->45.91.116.10:4081: use of closed network connection
Sep 6 12:35:50.155186404 (190h27m46.835381973s) [noise=true , address=45.91.116.13:4155 , piece_id=IU3QP6LPIUC2U7SZLT46QQX7SXDYRLT4L5O7YBKZMVUYC7AHF2HQ, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:47208->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:47208->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47208->45.91.116.13:4155: use of closed network connection
Sep 6 12:35:50.155259074 (190h27m46.835454643s) [noise=true , address=45.91.116.6:4973 , piece_id=7VVSG6UAUVTUGK6LOR7U26X6QUCZ7EZMC4BO5H7GEDOCARRROCTA, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 188.166.225.170:57922->45.91.116.6:4973: use of closed network connection; write tcp 188.166.225.170:57922->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57922->45.91.116.6:4973: use of closed network connection
Sep 6 12:35:50.155762988 (190h27m46.835958557s) [noise=true , address=45.91.116.4:4939 , piece_id=KEH2V4EHIHP7QWJBZJSD7PMBHPGFPXENQP2BZ2OTCLNCVGPFAC5A, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:59002->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:59002->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59002->45.91.116.4:4939: use of closed network connection
Sep 6 12:35:50.155858010 (190h27m46.836053569s) [noise=true , address=77.90.31.14:4661 , piece_id=WRD5EUYWOWOOTJKUBNCPKYVZQSLBDCEYV7AEPAIARXXBPUNCJQCA, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 188.166.225.170:45192->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.155890722 (190h27m46.836086291s) [noise=true , address=77.90.31.10:4517 , piece_id=XJAT3YF7TOKMWPJW6FHPA75RY7J75GQMOR2GZXXD5BMD4BUEFOFA, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 188.166.225.170:57514->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.155920870 (190h27m46.836116439s) [noise=true , address=77.90.31.17:4772 , piece_id=UXY3QBXFBTBYBZGWDWEMOH63LBDXSFV23RJ4Y3LBIFQT3I5L33SA, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:36182->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.155948723 (190h27m46.836144292s) [noise=true , address=45.91.116.14:4189 , piece_id=LV6QKGXQST6BYHDRBTJOU3N6BRPGNV7KOK7VNB4ZOCM6RPMTYZ3A, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 188.166.225.170:48436->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.155976396 (190h27m46.836171955s) [noise=true , address=45.91.116.4:4938 , piece_id=2SI4ISQPATXW6LHOAC5L7PWOKWYIVMO2VPR2GP2NKLHQNZPXA6BQ, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:33634->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156005111 (190h27m46.83620068s) [noise=true , address=45.91.116.14:4191 , piece_id=GSSANAAQAAUKP7UBSIHGKSXWIXAYAR4OROOLPM7RECQB7AO5YOWQ, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 188.166.225.170:55022->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156034046 (190h27m46.836229615s) [noise=true , address=45.91.116.13:4154 , piece_id=V7QAO5JQYCYOH7JPOQFMGQHJANO4GPDJFKZFCWSRUPMLYOOCMQOQ, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 188.166.225.170:41900->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156071668 (190h27m46.836267237s) [noise=true , address=45.91.116.8:4047 , piece_id=4BXPRGLDN3OOJE7V6FSBTIYZCO6BRHKFVXGPF33PXHJMI5VPZYYA, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 188.166.225.170:54958->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156101706 (190h27m46.836297275s) [noise=true , address=45.91.116.12:4227 , piece_id=TS6P5AEOE4XMM53WEHF56FEL6HQKALJCXGWGDIYYRN5JB7L2NWFQ, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: read tcp 188.166.225.170:39678->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156132385 (190h27m46.836327954s) [noise=true , address=45.91.116.11:4117 , piece_id=QPVZJOOJZB37G5V5PAAQ7CVHKO25UO4DRGWXP4WNOV5S27NFED4Q, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:58436->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156163594 (190h27m46.836359164s) [noise=true , address=45.91.116.12:4225 , piece_id=K7PD4DNPQ6NQIPH5KA3GVO2E6QRFTEMCDC3PUK5QSKIMNKIRS4KA, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 188.166.225.170:35712->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156202679 (190h27m46.836398248s) [noise=true , address=45.91.116.12:4226 , piece_id=RR3FINYJIQBKWQJTLOLMP3DKVYD7JS35WUASNOZUEIYCFYHMQEKQ, seg_pos={0 0}, upload=167538]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 188.166.225.170:48444->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:50.156214422 (190h27m46.836409991s) [seg_pos={0 0}, upload=167538]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 30.473102962s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
5 out of 60 is failed (threshold=3) [.................................................XX.X.X.X...] duration:
5.448366507s target:
https://us1.storj.io/login
FAIL (2025-09-06 12:35:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 5.448396234s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
7 out of 60 is failed (threshold=3) [...............................................XXXXXX..X....] duration:
19.537451304s
FAIL (2025-09-06 12:35:44 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 19.537474138s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
13 out of 60 is failed (threshold=3) [.............................................XXXXXXX.X.XXXXX] duration:
30.000580855s
FAIL (2025-09-06 12:35:34 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.000614049s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
8 out of 60 is failed (threshold=3) [.................................................X.XX.XXX.XX] duration:
30.000933018s
FAIL (2025-09-06 12:35:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:35:01.979841935 (190h26m58.660037514s) [upload=167532]: Starting upload Sep 6 12:35:01.979946053 (190h26m58.660141622s) [upload=167532]: Done starting upload Sep 6 12:35:01.980026697 (190h26m58.660222276s) [upload=167532]: Uploading segments... Sep 6 12:35:01.980087004 (190h26m58.660282583s) [upload=167532]: Got next segment. Inline: true Sep 6 12:35:01.980093776 (190h26m58.660289355s) [upload=167532]: Waiting for error group managing segments... Sep 6 12:35:01.980150825 (190h26m58.660346404s) [upload=167532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:35:01.980158400 (190h26m58.660353979s) [upload=167532]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Sep 6 12:35:01.980175783 (190h26m58.660371362s) [upload=167532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Sep 6 12:35:21.826294871 (190h27m18.50649044s) [upload=167532]: Done uploading segments... Sep 6 12:35:21.826313707 (190h27m18.506509276s) [upload=167532]: Upload finished. err: <nil>
Duration: 30.000955202s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration:
1m0.000934627s
FAIL (2025-09-06 12:35:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 6 12:35:10.765276581 (190h27m7.44547215s) [upload=167534]: Starting upload Sep 6 12:35:10.765333340 (190h27m7.445528909s) [upload=167534]: Done starting upload Sep 6 12:35:10.765422420 (190h27m7.445617989s) [upload=167534]: Uploading segments... Sep 6 12:35:10.765568460 (190h27m7.445764019s) [upload=167534]: Got next segment. Inline: false Sep 6 12:35:10.765602114 (190h27m7.445797683s) [upload=167534]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:35:10.765608055 (190h27m7.445803624s) [upload=167534]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Sep 6 12:35:27.421088132 (190h27m24.101283691s) [upload=167534]: Next segment err: context deadline exceeded Sep 6 12:35:27.421230025 (190h27m24.101425594s) [upload=167534]: Done uploading segments... Sep 6 12:35:27.421251425 (190h27m24.101446984s) [upload=167534]: Upload finished. err: context deadline exceeded
Duration: 1m0.000944105s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................................................X...X....X.] duration:
3.733002824s
FAIL (2025-09-06 12:35:26 UTC)
operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47)
Duration: 3.733020779s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
6 out of 60 is failed (threshold=3) [................................................XX.X....XXX.] duration:
19.89140255s
FAIL (2025-09-06 12:35:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:34:19.488654703 (190h26m16.168850332s) [upload=167526]: Starting upload Sep 6 12:34:19.488762580 (190h26m16.168958179s) [upload=167526]: Done starting upload Sep 6 12:34:19.488845679 (190h26m16.169041268s) [upload=167526]: Uploading segments... Sep 6 12:34:19.488896575 (190h26m16.169092144s) [upload=167526]: Got next segment. Inline: true Sep 6 12:34:19.488903429 (190h26m16.169098998s) [upload=167526]: Waiting for error group managing segments... Sep 6 12:34:19.488954346 (190h26m16.169149966s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:34:19.488960999 (190h26m16.169156608s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Sep 6 12:34:19.488965277 (190h26m16.169160866s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Sep 6 12:34:44.617583662 (190h26m41.297779281s) [upload=167526]: Done uploading segments... Sep 6 12:34:44.617605544 (190h26m41.297801103s) [upload=167526]: Upload finished. err: <nil>
Duration: 19.891431817s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................................X...X....X] duration:
30.021618401s
FAIL (2025-09-06 12:35:21 UTC)
operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47)
Duration: 30.021649549s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration:
1m0.1771814s
FAIL (2025-09-06 12:35:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 8)
======LOGS======
uAThZpAchkdT, address:185.167.204.206:4040): protocol: read tcp 188.166.225.170:51576->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.057590993 (190h27m14.737786552s) [noise=true , address=185.167.204.206:4049 , piece_id=L6PWJHETCSDJSMKPDG3Z6OIRW6IWKRYV4JRSEPEDLD4BJ4MUHWWQ, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.057649575 (190h27m14.737845144s) [noise=true , address=81.171.14.70:4042 , piece_id=NIYPRD5H2OUN575PB3QGBEHQXYSMVZLD4ZJXIEQUAD4DACDY5T2A, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:50498->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:50498->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50498->81.171.14.70:4042: use of closed network connection
Sep 6 12:35:18.057682889 (190h27m14.737878458s) [noise=true , address=185.167.204.206:4052 , piece_id=OCSPE6EY4FPBOERHF5F2GK6ET7CNLFAQHRVOQHBCPLVUDGLNVADA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.057697728 (190h27m14.737893297s) [noise=true , address=81.171.14.70:4026 , piece_id=63ZOQD6U256UXMYXUOJVF6NY3TACZQFBXVRXIWCNUS2YDQL2MCRA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 12:35:18.057711273 (190h27m14.737906842s) [noise=true , address=185.167.204.206:4044 , piece_id=GPGQSQ2MGOMYUHDUSODLQSILV6FWGYEA46QQWAHZPCXUGCUBC3GQ, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: read tcp 188.166.225.170:51060->185.167.204.206:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.057757532 (190h27m14.737953101s) [noise=true , address=185.167.204.205:4018 , piece_id=CSTDX6NTIXXI5IJAIBH2FNIGBEDHDCLN4ROHKESQPAQQ7YVK4YSA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: read tcp 188.166.225.170:39020->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.057827986 (190h27m14.738023555s) [noise=true , address=185.167.204.205:4036 , piece_id=ABPVJP3KXSJK6TLXSGFR25TB2OAOMWYOSYZTQ6V3WQDPYMYNSXMQ, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 188.166.225.170:35986->185.167.204.205:4036: use of closed network connection; write tcp 188.166.225.170:35986->185.167.204.205:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35986->185.167.204.205:4036: use of closed network connection
Sep 6 12:35:18.057874796 (190h27m14.738070365s) [noise=true , address=185.167.204.206:4047 , piece_id=7NBLTP5YLJB2E5M5WGVYMQXU4TKS5L7FTEYQXIF7Z3C6YCU4TPDQ, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:36658->185.167.204.206:4047: use of closed network connection; write tcp 188.166.225.170:36658->185.167.204.206:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36658->185.167.204.206:4047: use of closed network connection
Sep 6 12:35:18.057969608 (190h27m14.738165177s) [noise=true , address=185.167.204.206:4068 , piece_id=YAD54OGSUUF4S6EERZITZPC6IA7FZJROXJJMZLE7CTGUYPUCAIRA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 188.166.225.170:43948->185.167.204.206:4068: use of closed network connection; write tcp 188.166.225.170:43948->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43948->185.167.204.206:4068: use of closed network connection
Sep 6 12:35:18.057994805 (190h27m14.738190374s) [noise=true , address=185.167.204.205:4010 , piece_id=VU7JAUAI4BVKZGTRGDIAU6RLW7XTPG7CD5H4HSA7PNDGQSS4ZFAA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: write tcp 188.166.225.170:59108->185.167.204.205:4010: use of closed network connection; write tcp 188.166.225.170:59108->185.167.204.205:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59108->185.167.204.205:4010: use of closed network connection
Sep 6 12:35:18.058002801 (190h27m14.73819837s) [noise=true , address=81.171.14.70:4036 , piece_id=NAKKDEE2GTBGA3P2XFHDSFXYSO6QHJIG5KSALEC4HF2G5I2B2TUQ, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 188.166.225.170:55500->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.058026166 (190h27m14.738221735s) [noise=true , address=185.167.204.205:4028 , piece_id=NC72Q4RDYL724JOEO4UIAQNBJUWIUY4BCIWWASBY5DYQOJG6TF5A, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 188.166.225.170:60682->185.167.204.205:4028: use of closed network connection; write tcp 188.166.225.170:60682->185.167.204.205:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60682->185.167.204.205:4028: use of closed network connection
Sep 6 12:35:18.058058478 (190h27m14.738254047s) [noise=true , address=185.167.204.205:4015 , piece_id=CO2PNJMTJMUFWYRSK5YVUR2Z54VIK5Y52JAIXRTS3R522XCWEWVA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: write tcp 188.166.225.170:48596->185.167.204.205:4015: use of closed network connection; write tcp 188.166.225.170:48596->185.167.204.205:4015: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48596->185.167.204.205:4015: use of closed network connection
Sep 6 12:35:18.058103523 (190h27m14.738299092s) [noise=true , address=81.171.14.70:4033 , piece_id=IBZECJWB5ZV2KQUDT5WHEFEYJ2DGMHU7HFDAHEOOM4V3ENG6QX7A, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:38196->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:38196->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->81.171.14.70:4033: use of closed network connection
Sep 6 12:35:18.058169801 (190h27m14.73836537s) [noise=true , address=185.167.204.206:4050 , piece_id=TTK5CPZVFKP6BRYO5CTXXQMP5QYTMA463HH2OFKHZGM2UQNIE5CA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: read tcp 188.166.225.170:51458->185.167.204.206:4050: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.058176403 (190h27m14.738371972s) [noise=true , address=81.171.14.70:4031 , piece_id=G5SD57AHHQQIJAHAA3P4JRONTWMH5A6IENTL33TSFDUQOK4IU5VA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:44960->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:44960->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44960->81.171.14.70:4031: use of closed network connection
Sep 6 12:35:18.058184198 (190h27m14.738379767s) [noise=true , address=185.167.204.205:4008 , piece_id=K3KVB5NMHIEE3PPHMH6K6QZTOW5XMV2FKBYIJLX6ORXWVCFWN5NA, seg_pos={0 0}, upload=167525]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: read tcp 188.166.225.170:42806->185.167.204.205:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:35:18.058205008 (190h27m14.738400577s) [seg_pos={0 0}, upload=167525]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil>
Sep 6 12:35:18.233083634 (190h27m14.913279203s) [upload=167525]: Done uploading segments...
Sep 6 12:35:18.233134632 (190h27m14.913330221s) [upload=167525]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8)
Duration: 1m0.177193653s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration:
30.001250186s
FAIL (2025-09-06 12:35:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.001276857s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X..X.......] duration:
2.701635568s
FAIL (2025-09-06 12:35:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.701663411s
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration:
1m0.00115561s
FAIL (2025-09-06 12:35:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001166079s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [...............................................XX.......X...] duration:
1.88617719s remote:
"tcp:45.38.24.2:80" target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 12:35:00 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded
Duration: 1.886200604s
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
5 out of 60 is failed (threshold=3) [..................................................XX.X.X.X..] duration:
14.077218811s target:
https://us1.storj.io/login
FAIL (2025-09-06 12:34:58 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 14.077244861s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
6 out of 60 is failed (threshold=3) [.................................................XX.X....XXX] duration:
1m0.00083728s
FAIL (2025-09-06 12:34:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:34:19.488654703 (190h26m16.168850332s) [upload=167526]: Starting upload Sep 6 12:34:19.488762580 (190h26m16.168958179s) [upload=167526]: Done starting upload Sep 6 12:34:19.488845679 (190h26m16.169041268s) [upload=167526]: Uploading segments... Sep 6 12:34:19.488896575 (190h26m16.169092144s) [upload=167526]: Got next segment. Inline: true Sep 6 12:34:19.488903429 (190h26m16.169098998s) [upload=167526]: Waiting for error group managing segments... Sep 6 12:34:19.488954346 (190h26m16.169149966s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:34:19.488960999 (190h26m16.169156608s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Sep 6 12:34:19.488965277 (190h26m16.169160866s) [upload=167526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Sep 6 12:34:44.617583662 (190h26m41.297779281s) [upload=167526]: Done uploading segments... Sep 6 12:34:44.617605544 (190h26m41.297801103s) [upload=167526]: Upload finished. err: <nil>
Duration: 1m0.00084722s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [X......X......................X......X.....X.XXXXXXXXXXXXXXX] duration:
33.373986169s
FAIL (2025-09-06 12:34:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
[noise=true , address=45.91.116.5:4298 , piece_id=QZKO6YRHJKCO6EK5DP6BO27RCHC5EMV72G3XUHXT5V7CMMUR6VOQ, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:16.753956789 (190h26m13.434152358s) [noise=true , address=45.91.116.5:4297 , piece_id=6HIM5H6G66KGBCGZF6N5NJYGP5HI7LHIEKHGGER2PQSCEXPRLQJQ, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:16.754159266 (190h26m13.434354835s) [noise=true , address=45.91.116.6:4975 , piece_id=RDDTB2BSI3ROKNMGYFFZZ2NLLMNTYVJBNEZPVXIALRYJAGJM7CLQ, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:16.754294295 (190h26m13.434489864s) [noise=true , address=45.91.116.10:4082 , piece_id=XAUDQ2LIM4LDKLZL5AYKPRJP5MF6CVPPW2IKLSQ3XFS3VYIV2QYA, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:16.754387342 (190h26m13.434582911s) [noise=true , address=45.91.116.12:4225 , piece_id=YRONM62BHSZAYHETHG7HLIW42ZFYV5LIJN6FYENH33RNKJQ6YBDA, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:16.754529435 (190h26m13.434725004s) [noise=true , address=45.91.116.6:4973 , piece_id=2J4XL6KTHUS4OYLT54A54YI75QB43KHGRMNJVHBRW5APOCFYA5OA, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:16.754764694 (190h26m13.434960264s) [noise=true , address=45.91.116.4:4938 , piece_id=GNHN7VU6OQGMP4SW7ESE5NUY37BWEQFM3CXYPFR7T5F77YXNOK3A, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:16.755081621 (190h26m13.43527719s) [noise=true , address=77.90.31.10:4517 , piece_id=6ZH23CGCL74DCNMGYZXMS2ZJXCGFSCQP54N44M2YYNHPSXMGM3SQ, seg_pos={0 0}, upload=167523]: Uploading piece...
Sep 6 12:34:42.469869050 (190h26m39.150064619s) [upload=167523]: Next segment err: context deadline exceeded
Sep 6 12:34:42.470168964 (190h26m39.150364533s) [noise=true , address=45.91.116.12:4225 , piece_id=YRONM62BHSZAYHETHG7HLIW42ZFYV5LIJN6FYENH33RNKJQ6YBDA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 188.166.225.170:38610->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:38610->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38610->45.91.116.12:4225: use of closed network connection
Sep 6 12:34:42.470651277 (190h26m39.150846846s) [noise=true , address=45.91.116.13:4153 , piece_id=P7JLCCMTAH7XQ2D5SNKIYWGKMHNZBSEYDV4WT7VTOMHZ65YXH3OA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 188.166.225.170:39890->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470693738 (190h26m39.150889307s) [noise=true , address=45.91.116.10:4082 , piece_id=XAUDQ2LIM4LDKLZL5AYKPRJP5MF6CVPPW2IKLSQ3XFS3VYIV2QYA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: read tcp 188.166.225.170:56256->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470726892 (190h26m39.150922461s) [noise=true , address=45.91.116.8:4047 , piece_id=4A3OS5N6EGCXWUDZADGLDVZ6OIYYBZOGUNFFG2I7AQYFPFV4VQXQ, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 188.166.225.170:43518->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470747000 (190h26m39.150942569s) [noise=true , address=45.91.116.5:4297 , piece_id=6HIM5H6G66KGBCGZF6N5NJYGP5HI7LHIEKHGGER2PQSCEXPRLQJQ, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:33194->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:33194->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33194->45.91.116.5:4297: use of closed network connection
Sep 6 12:34:42.470758763 (190h26m39.150954332s) [noise=true , address=45.91.116.10:4083 , piece_id=QKSIYXEV4NII5Q5OHF4JSDISGPZXUN44AXLADQJBS56LHOY2ERLA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:43992->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470793549 (190h26m39.150989118s) [noise=true , address=45.91.116.13:4155 , piece_id=UXE7TZVKZGHBYJTCIZMVTIETMTB2FS37EKXTZBHM3XEAMMHNQLVQ, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 188.166.225.170:45104->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470821673 (190h26m39.151017242s) [noise=true , address=45.91.116.4:4938 , piece_id=GNHN7VU6OQGMP4SW7ESE5NUY37BWEQFM3CXYPFR7T5F77YXNOK3A, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:44618->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470853193 (190h26m39.151048762s) [noise=true , address=77.90.31.10:4517 , piece_id=6ZH23CGCL74DCNMGYZXMS2ZJXCGFSCQP54N44M2YYNHPSXMGM3SQ, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 188.166.225.170:58120->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470878752 (190h26m39.151074321s) [noise=true , address=45.91.116.13:4154 , piece_id=2WP7LGLTZJMH25PAGQJ7ESZRV6LRM6P3NNOAFTTDU57AMXLKG2QA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 188.166.225.170:52768->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470913649 (190h26m39.151109218s) [noise=true , address=45.91.116.7:4011 , piece_id=6UBWE4TXBBJ2OF474EPHFDSABBTO5QQ6CBVMTZE4Z74C6CUFI2SA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:33552->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.470961210 (190h26m39.151156779s) [noise=true , address=45.91.116.6:4975 , piece_id=RDDTB2BSI3ROKNMGYFFZZ2NLLMNTYVJBNEZPVXIALRYJAGJM7CLQ, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: write tcp 188.166.225.170:41710->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:41710->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41710->45.91.116.6:4975: use of closed network connection
Sep 6 12:34:42.471032116 (190h26m39.151227685s) [noise=true , address=45.91.116.5:4298 , piece_id=QZKO6YRHJKCO6EK5DP6BO27RCHC5EMV72G3XUHXT5V7CMMUR6VOQ, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 188.166.225.170:56184->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.471053496 (190h26m39.151249065s) [noise=true , address=45.91.116.6:4973 , piece_id=2J4XL6KTHUS4OYLT54A54YI75QB43KHGRMNJVHBRW5APOCFYA5OA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37742->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.471094545 (190h26m39.151290114s) [noise=true , address=45.91.116.12:4226 , piece_id=HGH45GUFZSMKSE4J5N253QJ7PNJEFUUWZ4DCJTPROTLPPUICCOOA, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 188.166.225.170:57340->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.471110095 (190h26m39.151305664s) [noise=true , address=45.91.116.11:4118 , piece_id=24ZNZUH6AZD6ASXSRMBD5FWKWH3G6J5FP5OR5SRFTTEHOTBLQ4IQ, seg_pos={0 0}, upload=167523]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 188.166.225.170:46034->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:42.471125925 (190h26m39.151321494s) [seg_pos={0 0}, upload=167523]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 33.374008391s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
7 out of 60 is failed (threshold=3) [................................................XXXXXX..X...] duration:
30.000499773s
FAIL (2025-09-06 12:34:41 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.000520421s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
7 out of 60 is failed (threshold=3) [..................................................X.XX.XXX.X] duration:
30.000534286s
FAIL (2025-09-06 12:34:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 12:34:12.603088176 (190h26m9.283283745s) [upload=167522]: Starting upload Sep 6 12:34:12.603172467 (190h26m9.283368036s) [upload=167522]: Done starting upload Sep 6 12:34:12.603229155 (190h26m9.283424724s) [upload=167522]: Uploading segments... Sep 6 12:34:12.603276326 (190h26m9.283471895s) [upload=167522]: Got next segment. Inline: true Sep 6 12:34:12.603280113 (190h26m9.283475682s) [upload=167522]: Waiting for error group managing segments... Sep 6 12:34:12.603312525 (190h26m9.283508094s) [upload=167522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Sep 6 12:34:12.603316312 (190h26m9.283511871s) [upload=167522]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Sep 6 12:34:12.603318687 (190h26m9.283514256s) [upload=167522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Sep 6 12:34:39.692305781 (190h26m36.37250135s) [upload=167522]: Done uploading segments... Sep 6 12:34:39.692329266 (190h26m36.372524835s) [upload=167522]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000559285s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
5 out of 60 is failed (threshold=3) [...................................................XX.X.X.X.] duration:
22.304772301s target:
https://us1.storj.io/login
FAIL (2025-09-06 12:34:39 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 22.304794174s
core
satellite
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X......X..] duration:
5.774883998s
FAIL (2025-09-06 12:34:31 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 44)
Duration: 5.774913234s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
12 out of 60 is failed (threshold=3) [..............................................XXXXXXX.X.XXXX] duration:
10.429656036s
FAIL (2025-09-06 12:34:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 10.429678911s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration:
1m0.458831705s
FAIL (2025-09-06 12:34:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
onnection; piecestore: piecestore close: write tcp 188.166.225.170:37044->145.79.227.7:4300: use of closed network connection
Sep 6 12:34:26.729994994 (190h26m23.410190563s) [noise=true , address=45.91.116.5:4321 , piece_id=LVH2RKGFAOEEAGJERXCG4E4NYVMY3XHO3OF6TWHSRDWCDO4QVUZA, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj, address:45.91.116.5:4321): protocol: write tcp 188.166.225.170:39620->45.91.116.5:4321: use of closed network connection; write tcp 188.166.225.170:39620->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39620->45.91.116.5:4321: use of closed network connection
Sep 6 12:34:26.730056692 (190h26m23.410252261s) [noise=true , address=145.79.227.51:4431 , piece_id=QXG2VBQ5GPXEWBB67WFOXZGLCM7HYX6TUV2TZIS2VSWSUNRTC6JQ, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj, address:145.79.227.51:4431): protocol: write tcp 188.166.225.170:51672->145.79.227.51:4431: use of closed network connection; write tcp 188.166.225.170:51672->145.79.227.51:4431: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51672->145.79.227.51:4431: use of closed network connection
Sep 6 12:34:26.730096338 (190h26m23.410291898s) [noise=true , address=145.79.227.19:4095 , piece_id=CPYHWRHKB46QBB7QMXNCDUHU34H3DQYMZBU3M4WK7LVGOVRP5GQQ, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: write tcp 188.166.225.170:44484->145.79.227.19:4095: use of closed network connection; write tcp 188.166.225.170:44484->145.79.227.19:4095: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44484->145.79.227.19:4095: use of closed network connection
Sep 6 12:34:26.730145572 (190h26m23.410341131s) [noise=true , address=145.79.227.33:4894 , piece_id=7XM2H3BB4V4KROFVRA7QSQKD5FJELA6DDM374NOOCQ26CN72DZOA, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:33274->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:33274->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33274->145.79.227.33:4894: use of closed network connection
Sep 6 12:34:26.730180059 (190h26m23.410375618s) [noise=true , address=145.79.227.49:4365 , piece_id=CUQBW5UN5YP5BQRGD623BYDV7ARO2VHHUV3OU7XC2M5DP2JQQVEA, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: write tcp 188.166.225.170:50664->145.79.227.49:4365: use of closed network connection; write tcp 188.166.225.170:50664->145.79.227.49:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50664->145.79.227.49:4365: use of closed network connection
Sep 6 12:34:26.730190659 (190h26m23.410386228s) [noise=true , address=77.90.31.14:4665 , piece_id=SABEPVTUVHRFI2SO7NG7LKCAGKJTH7TCLN2TVBQSP5YEIBGRA2RA, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12W4n6uf6azQk1QgeR8Xw7UkpnZm19zdyFKwojCsqZt2GFHrpce, address:77.90.31.14:4665): protocol: write tcp 188.166.225.170:43578->77.90.31.14:4665: use of closed network connection; write tcp 188.166.225.170:43578->77.90.31.14:4665: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43578->77.90.31.14:4665: use of closed network connection
Sep 6 12:34:26.730223671 (190h26m23.410419231s) [noise=true , address=145.79.227.35:4516 , piece_id=KHTCCWVM5O4YSD6GERKB3OCGE74JCMZ424JFAPGXZVST6DXWNTPQ, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12FRYABJbf6iHTm3WiYcL192kFth6rHjrcMAS3ahF8ddm4ox6Uj, address:145.79.227.35:4516): protocol: write tcp 188.166.225.170:46540->145.79.227.35:4516: use of closed network connection; write tcp 188.166.225.170:46540->145.79.227.35:4516: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46540->145.79.227.35:4516: use of closed network connection
Sep 6 12:34:26.730256195 (190h26m23.410451754s) [noise=true , address=145.79.227.4:4211 , piece_id=PTZAOFJCUY3NM46LHZ5JKXJURA3WZRLQEWQFRSQYMRY5NZFATDQQ, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12dANoYTygpcpWfCcAJtsnVBFWSekLhDjheAXnsaYMChRYAm2qc, address:145.79.227.4:4211): protocol: write tcp 188.166.225.170:56976->145.79.227.4:4211: use of closed network connection; write tcp 188.166.225.170:56976->145.79.227.4:4211: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56976->145.79.227.4:4211: use of closed network connection
Sep 6 12:34:26.730287284 (190h26m23.410482853s) [noise=true , address=145.79.227.37:4600 , piece_id=CLMBQD5KELME7XYCT3D4DE3BNQGBWJEBOP6RA55YC7KOJKOE4SYQ, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:1XPNfzLxtEXZKKU4KYpzFRSscCrQeNzY5K32ESPqjoVLPniPjJ, address:145.79.227.37:4600): protocol: read tcp 188.166.225.170:47616->145.79.227.37:4600: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:26.730321880 (190h26m23.410517449s) [noise=true , address=145.79.227.14:4851 , piece_id=AFJLNVBC3PIJYXPDXKRB4FJGKRUEIPKEAVZEUT2INYQANHTLQYRQ, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R, address:145.79.227.14:4851): protocol: read tcp 188.166.225.170:59648->145.79.227.14:4851: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:26.730330015 (190h26m23.410525584s) [noise=true , address=45.91.116.6:4003 , piece_id=P254LTZUSHSU5A7HAVKPZ5ZQYL52YK7INBIY3F4TNQNFB2IPQZOA, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:1veqoBGw6a8AGMoigyuNJMjcEvCT93xRq2B1d2KNhs6aEmSqVF, address:45.91.116.6:4003): protocol: write tcp 188.166.225.170:45570->45.91.116.6:4003: use of closed network connection; write tcp 188.166.225.170:45570->45.91.116.6:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45570->45.91.116.6:4003: use of closed network connection
Sep 6 12:34:26.730351226 (190h26m23.410546795s) [noise=true , address=145.79.227.3:4170 , piece_id=A2S4Q6XIZ5M6A5GRZHMCPLNL2W4FXBHGGHRSY62DJRP4RUFOGPKA, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:1EfVDsPfsWymV1yfufQw2BidpCGqqqsmtrvoid67a5ug9YYyyd, address:145.79.227.3:4170): protocol: write tcp 188.166.225.170:59256->145.79.227.3:4170: use of closed network connection; write tcp 188.166.225.170:59256->145.79.227.3:4170: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59256->145.79.227.3:4170: use of closed network connection
Sep 6 12:34:26.730367107 (190h26m23.410562676s) [noise=true , address=145.79.227.2:4125 , piece_id=ZOTS3SFDMNCTJAXFVUG2YGG3YR5MS6D7KU5FZ53QMLY6ZCTYWR5Q, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:145.79.227.2:4125): protocol: write tcp 188.166.225.170:48144->145.79.227.2:4125: use of closed network connection; write tcp 188.166.225.170:48144->145.79.227.2:4125: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48144->145.79.227.2:4125: use of closed network connection
Sep 6 12:34:26.730399388 (190h26m23.410594957s) [noise=true , address=77.90.31.12:4602 , piece_id=CFIHX4PWVFIKOLBRQKAEZLETSHFMXVE3X2ZOBYV2YR5OSFOPJD3Q, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: read tcp 188.166.225.170:60906->77.90.31.12:4602: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:26.730427712 (190h26m23.410623282s) [noise=true , address=145.79.227.44:4208 , piece_id=2G6MJENGHVSNXUCOIMIGXHNX3ITXABPLQOSIW26Z2JBNB4PNPK2Q, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12pTsKDUmbk8xYNnjrcYyX4qxwLSfHzsGgkUGSbrBiWPARfBrfi, address:145.79.227.44:4208): protocol: read tcp 188.166.225.170:47880->145.79.227.44:4208: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:26.730469362 (190h26m23.410664931s) [noise=true , address=145.79.227.42:4124 , piece_id=C2QSO5LLRIOLKL7333YVYHEDMVUEEWIZ3K5BDNHAMA5LXAN4XNDQ, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: read tcp 188.166.225.170:37134->145.79.227.42:4124: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:26.730512394 (190h26m23.410707963s) [noise=true , address=145.79.227.52:4474 , piece_id=NGLHVYJLCLCVAPWOMKUJUZ4FWBTUFTPF6CAXL43F7AU3PLZUFJ3Q, seg_pos={0 0}, upload=167517]: Done uploading piece. err: ecclient: upload failed (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j, address:145.79.227.52:4474): protocol: read tcp 188.166.225.170:47972->145.79.227.52:4474: use of closed network connection; context deadline exceeded
Sep 6 12:34:26.730543414 (190h26m23.410738983s) [seg_pos={0 0}, upload=167517]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 1m0.458845982s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X..X......] duration:
10.430576421s
FAIL (2025-09-06 12:34:26 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 10.430600658s
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration:
1m0.184599671s
FAIL (2025-09-06 12:34:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 12)
======LOGS======
. err: <nil>
Sep 6 12:33:19.814782374 (190h25m16.494977943s) [noise=true , address=89.149.201.147:4003 , piece_id=L4ZEG4LWX37OH4CXBYXLPI25WKCHVSUY4LN7Q36C5SVGUWSHOJEQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: <nil>
Sep 6 12:33:19.838441968 (190h25m16.518637527s) [noise=true , address=89.149.201.147:4005 , piece_id=LLWSNDIG44TFS27YTALM4CD56QC6CUDSBRADYUHNCDQOF53DAC6Q, seg_pos={0 0}, upload=167513]: Done uploading piece. err: <nil>
Sep 6 12:33:19.841930062 (190h25m16.522125631s) [noise=true , address=89.149.201.147:4002 , piece_id=SSIH6BXKBNXXZDYCLKDQEM6N3BMAYTXPQYNUDQDNJTJQLMRXQANA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: <nil>
Sep 6 12:34:17.645031319 (190h26m14.325226888s) [noise=true , address=81.171.14.70:4025 , piece_id=CZD5MNB4UA6N6MHWMEX5XXCACQ2M7NL4MYOAEJPW7CSQKG2ZIEJQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:49728->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.645110281 (190h26m14.32530585s) [noise=true , address=81.171.14.70:4031 , piece_id=6ZKM3NL576MXDXI3O2YMV4TBJ3APJG3E5I7UECOPJALQANDFVXDQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:54124->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:54124->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54124->81.171.14.70:4031: use of closed network connection
Sep 6 12:34:17.645250128 (190h26m14.325445697s) [noise=true , address=81.171.14.70:4039 , piece_id=W3GZIIJA4STMTHMX3CXA6P6AHI5ISJ45HCPRIESSTHCSUBJGTNHQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:43954->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:43954->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43954->81.171.14.70:4039: use of closed network connection
Sep 6 12:34:17.645473656 (190h26m14.325669225s) [noise=true , address=81.171.14.70:4035 , piece_id=GI5QXIHN2HQYX4MQLCGLKV6QNFKRYZ747Q2ALFZ6N53JYAO63RSQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:33072->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:33072->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33072->81.171.14.70:4035: use of closed network connection
Sep 6 12:34:17.645506368 (190h26m14.325701937s) [noise=true , address=185.167.204.206:4051 , piece_id=FICCRPMDZXIF5OAFAA6NRQ3EFLLSO7Y6H4RO2PZMIYA5OLZZED6Q, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:58970->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:58970->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58970->185.167.204.206:4051: use of closed network connection
Sep 6 12:34:17.645533821 (190h26m14.32572939s) [noise=true , address=81.171.14.70:4026 , piece_id=4JM4LDIPQUKSK6TC2OPGSKESVHRRZTZLP5UIQSH4BLHQ67TGOLTQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:42914->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:42914->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42914->81.171.14.70:4026: use of closed network connection
Sep 6 12:34:17.645551725 (190h26m14.325747284s) [noise=true , address=185.167.204.205:4001 , piece_id=D4URKFTJB3GCGZ5A2BPFARSYZNO5UT2FJZ2VT2Y4LAHSJG7JOOLA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:38730->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:38730->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38730->185.167.204.205:4001: use of closed network connection
Sep 6 12:34:17.645610307 (190h26m14.325805886s) [noise=true , address=185.167.204.205:4024 , piece_id=4LNM4XBDGOVRCAQIMGR4A3RWRC6NIKIY7WEHEII7EJ6ZGWZCABDA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 188.166.225.170:58062->185.167.204.205:4024: use of closed network connection; write tcp 188.166.225.170:58062->185.167.204.205:4024: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58062->185.167.204.205:4024: use of closed network connection
Sep 6 12:34:17.645701802 (190h26m14.325897371s) [noise=true , address=185.167.204.206:4065 , piece_id=BLEZGPO6W6WUUBH6MZ4XIGYR5KEYJ2G4HXNZ3GI34YBZCEUFBOVA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: read tcp 188.166.225.170:55600->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.645757498 (190h26m14.325953067s) [noise=true , address=185.167.204.205:4019 , piece_id=IRUQA46BCGWD5CWZHHX4KKG4YPAJKOXGS6SV3JION35JNMLVADKQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: write tcp 188.166.225.170:56830->185.167.204.205:4019: use of closed network connection; write tcp 188.166.225.170:56830->185.167.204.205:4019: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56830->185.167.204.205:4019: use of closed network connection
Sep 6 12:34:17.645832442 (190h26m14.326028011s) [noise=true , address=81.171.14.70:4040 , piece_id=UT6ZUGAKGDQLDDVHHCZO4AUOQYZHEUS7PL367JN3WA75JB2YO6VA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:52896->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.645869382 (190h26m14.326064951s) [noise=true , address=185.167.204.205:4017 , piece_id=JHR4RL7GO7ZRYJSVTQQQEC46BLAI5WO5FXMB2JFFVRLRM6Z2WAMA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 188.166.225.170:59778->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.645999882 (190h26m14.326195451s) [noise=true , address=185.167.204.206:4052 , piece_id=YAPFCOR4IVK4APOOOTLWJ73RE6RKAMGMKTULOSNQ6UZFAWEWYJGQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: read tcp 188.166.225.170:38872->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.646046792 (190h26m14.326242361s) [noise=true , address=185.167.204.205:4010 , piece_id=S46QGR5VLG5TWGEOPT6ABYJXZE7V5BNPWM3II75Q244AADJ5ZGOA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 188.166.225.170:57042->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.646074686 (190h26m14.326270255s) [noise=true , address=185.167.204.206:4043 , piece_id=NYKRZ2EYUKJV2HPDXIGWYVQGXN4BCIMSG6O4SSYX73PHMVAADDFQ, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: read tcp 188.166.225.170:56370->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.646097880 (190h26m14.326293449s) [noise=true , address=185.167.204.206:4054 , piece_id=BPMZDHNWTFCFJWYG4JA53BXMABSLAGMBBSFA3IPDEW7DWU5JDOCA, seg_pos={0 0}, upload=167513]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: read tcp 188.166.225.170:53606->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 6 12:34:17.646120704 (190h26m14.326316273s) [seg_pos={0 0}, upload=167513]: Done waiting for segment. successful: 12 optimal: 26 errs: <nil>
Sep 6 12:34:17.827125653 (190h26m14.507321222s) [upload=167513]: Done uploading segments...
Sep 6 12:34:17.827159097 (190h26m14.507354696s) [upload=167513]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 12)
Duration: 1m0.184613348s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
5 out of 60 is failed (threshold=3) [....................................................XX.X.X.X] duration:
30.001066422s target:
https://us1.storj.io/login
FAIL (2025-09-06 12:34:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 30.001088454s
core
satellite
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration:
10.431292601s
FAIL (2025-09-06 12:34:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 10.431315264s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [................................................XX.......X..] duration:
3.971523029s remote:
"tcp:45.38.24.2:80" target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 12:34:06 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded
Duration: 3.971552385s
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration:
1m0.001008364s
FAIL (2025-09-06 12:34:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001020857s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X......X.] duration:
5.556313338s
FAIL (2025-09-06 12:34:01 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 44)
Duration: 5.556342594s
core
uplink
eu1
|