Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 478610 reports (Page 5847 of 9573)
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX]
duration:
1m0.178672875s
FAIL (2025-09-06 09:33:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 7)
======LOGS======
: use of closed network connection
Sep  6 09:33:53.501592982 (187h25m50.181788551s) [noise=true , address=185.167.204.206:4065 , piece_id=ZRKVHVF4UDZZWQCJJYXZB2GACXSJ7PX2467ZAXGUEQCSIY2CQWPA, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49094->185.167.204.206:4065: use of closed network connection; write tcp 188.166.225.170:49094->185.167.204.206:4065: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49094->185.167.204.206:4065: use of closed network connection
Sep  6 09:33:53.501689988 (187h25m50.181885557s) [noise=true , address=185.167.204.206:4064 , piece_id=LFQSD6UDL337ORMA3PYXZFCXRAFO7THLJH3P7A4X3PPTKPEF4ESQ, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: write tcp 188.166.225.170:41026->185.167.204.206:4064: use of closed network connection; write tcp 188.166.225.170:41026->185.167.204.206:4064: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41026->185.167.204.206:4064: use of closed network connection
Sep  6 09:33:53.501828563 (187h25m50.182024132s) [noise=true , address=185.167.204.206:4060 , piece_id=4GF27X7NQ2MVCT4ECV7MRGR3FNKVNQVU2S7QPNSPDUSZJFIJZDVQ, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:53582->185.167.204.206:4060: use of closed network connection; write tcp 188.166.225.170:53582->185.167.204.206:4060: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53582->185.167.204.206:4060: use of closed network connection
Sep  6 09:33:53.501843320 (187h25m50.182038889s) [noise=true , address=81.171.14.70:4046    , piece_id=2KCZPFURXEJSVXHLFO6HURMWSUSD4VTNPOWHYECZHLLIKDXTMFWA, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:56092->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:56092->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->81.171.14.70:4046: use of closed network connection
Sep  6 09:33:53.501883969 (187h25m50.182079538s) [noise=true , address=81.171.14.70:4041    , piece_id=E7RSYXKQSEFTNFWEHUSLP5EC5XJRBNLKM6PTNDUM43NOOEKFFG4Q, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:52928->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:52928->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52928->81.171.14.70:4041: use of closed network connection
Sep  6 09:33:53.501953311 (187h25m50.18214888s) [noise=true , address=81.171.14.70:4035    , piece_id=ZAHRFORXU6SDO6IOM5WDHACRL2VSALVFW4PB7P63VVU3OMVQTZ3A, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:33502->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:33502->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33502->81.171.14.70:4035: use of closed network connection
Sep  6 09:33:53.501969162 (187h25m50.182164731s) [noise=true , address=185.167.204.205:4013 , piece_id=3KX3KWQMTJC4SVNTBHEMX3RGQTG5RPSSWDL2ZQJ2UEQTFCNOLO6Q, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 188.166.225.170:36042->185.167.204.205:4013: use of closed network connection; write tcp 188.166.225.170:36042->185.167.204.205:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36042->185.167.204.205:4013: use of closed network connection
Sep  6 09:33:53.502007444 (187h25m50.182203013s) [noise=true , address=185.167.204.206:4049 , piece_id=VT72TD3THLQ4ANWHPFNERA76K5WQ2L3Z5G6H3VFWQBEVDB6RTIPA, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:43870->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:43870->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43870->185.167.204.206:4049: use of closed network connection
Sep  6 09:33:53.502020720 (187h25m50.182216289s) [noise=true , address=185.167.204.205:4022 , piece_id=EBEBJL5ZT25PYBFY5VUWO2BKI35Z3VPJEC2ZEOLH6RVYIPP3OYLQ, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: write tcp 188.166.225.170:33310->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:33310->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33310->185.167.204.205:4022: use of closed network connection
Sep  6 09:33:53.502043875 (187h25m50.182239444s) [noise=true , address=81.171.14.70:4032    , piece_id=QZQMYIMTSGEWVCKFDJV4KTVHZB6N53XJJVKMDDRPFAIYWFCBJE5Q, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: read tcp 188.166.225.170:36174->81.171.14.70:4032: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502078090 (187h25m50.182273659s) [noise=true , address=185.167.204.206:4045 , piece_id=JA6ICGJ6JUF5ACVYMP5IILBGTAEMEL3YQJOL6VDXAK42ZC5JL2JA, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1JPbi9CNAvezq91fdgjboVcgrdwwN48dFfLXzzgXtJ9B5eEoYq, address:185.167.204.206:4045): protocol: read tcp 188.166.225.170:33592->185.167.204.206:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502108488 (187h25m50.182304057s) [noise=true , address=185.167.204.205:4034 , piece_id=BI4TZRVDZP23WGZ73IXHT2DX2ZRVXOJWVZYWCUVZLVLKDGSDLPPA, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: read tcp 188.166.225.170:37352->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502175937 (187h25m50.182371506s) [noise=true , address=185.167.204.206:4062 , piece_id=7CR3OFYTBHNOONRZLEUR34X6CFNAJ4I6LKGCPUID3GIT7ZZXPEXQ, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: read tcp 188.166.225.170:48694->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502188812 (187h25m50.182384381s) [noise=true , address=185.167.204.206:4050 , piece_id=HBYWYEC62U6FCFRREFR77CASOALIA5IJON2AO4ROIA3YINOQAVKA, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: read tcp 188.166.225.170:36364->185.167.204.206:4050: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502213960 (187h25m50.182409529s) [noise=true , address=185.167.204.206:4058 , piece_id=J6Z5EOQLOHCQ26CHXGCCBWLFLPLSTTZAOPFZCICKH5QCQZSNS4YA, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: read tcp 188.166.225.170:39024->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502224690 (187h25m50.182420259s) [noise=true , address=81.171.14.70:4026    , piece_id=6IMF7N7S5OKGJBSLY33UEXJVPZLOIBRL4C342Y5TR645P4Q3HJ7Q, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: read tcp 188.166.225.170:55614->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502389355 (187h25m50.182584924s) [noise=true , address=185.167.204.205:4016 , piece_id=AYX73VY4Z34PBBEDL3MFJLL45RLCDRJ6F3QDFPNVXIFHOLY2R5XQ, seg_pos={0 0}, upload=164929]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 188.166.225.170:55682->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:33:53.502408522 (187h25m50.182604091s) [seg_pos={0 0}, upload=164929]: Done waiting for segment. successful: 7 optimal: 26 errs: <nil>
Sep  6 09:33:53.678075908 (187h25m50.358271467s) [upload=164929]: Done uploading segments...
Sep  6 09:33:53.678100645 (187h25m50.358296214s) [upload=164929]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 7)
Duration: 1m0.178685038s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
4 out of 60 is failed (threshold=3) [....................................................XXX....X]
duration:
1m1.906053614s
remote:
"tcp:35.212.10.183:443"
target:
https://us1.storj.io/login
FAIL (2025-09-06 09:33:53 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 1m1.906068863s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
8 out of 60 is failed (threshold=3) [...............................................X.X.X.X.XX.XX]
duration:
30.000478199s
FAIL (2025-09-06 09:33:51 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 30.000501725s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX]
duration:
30.001303769s
FAIL (2025-09-06 09:33:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001322274s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
12 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXX.]
duration:
24.487952773s
FAIL (2025-09-06 09:33:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 24.48797702s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
3 out of 60 is failed (threshold=3) [...................................................X..X..X..]
duration:
9.51669912s
FAIL (2025-09-06 09:33:27 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 9.516733155s edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
1.892230536s
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 09:33:23 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 1.892255022s edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX]
duration:
30.000961671s
FAIL (2025-09-06 09:33:22 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 30.000973042s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
8 out of 60 is failed (threshold=3) [...............................................XXXXXX.....XX]
duration:
30.001303115s
FAIL (2025-09-06 09:33:22 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:33:02.604062842 (187h24m59.284258411s) [upload=164931]: Starting upload
Sep  6 09:33:02.604148716 (187h24m59.284344285s) [upload=164931]: Done starting upload
Sep  6 09:33:02.604231995 (187h24m59.284427564s) [upload=164931]: Uploading segments...
Sep  6 09:33:02.604332979 (187h24m59.284528548s) [upload=164931]: Got next segment. Inline: true
Sep  6 09:33:02.604338439 (187h24m59.284534018s) [upload=164931]: Waiting for error group managing segments...
Sep  6 09:33:02.604388385 (187h24m59.284583964s) [upload=164931]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:33:02.604395398 (187h24m59.284590967s) [upload=164931]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:33:02.604398865 (187h24m59.284594434s) [upload=164931]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:33:15.518009449 (187h25m12.198205018s) [upload=164931]: Done uploading segments...
Sep  6 09:33:15.518028005 (187h25m12.198223574s) [upload=164931]: Upload finished. err: <nil>
Duration: 30.001322611s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX]
duration:
30.001254198s
FAIL (2025-09-06 09:33:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001276732s edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
5.248371862s
FAIL (2025-09-06 09:33:00 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 46)
Duration: 5.248396689s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
7 out of 60 is failed (threshold=3) [................................................X.X.X.X.XX.X]
duration:
30.000797677s
FAIL (2025-09-06 09:32:56 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 30.000817397s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [................................................X..X....X.X.]
duration:
5.594598689s
FAIL (2025-09-06 09:32:55 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 47)
Duration: 5.594618206s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
4 out of 60 is failed (threshold=3) [....................................................XX...XX.]
duration:
14.650979703s
FAIL (2025-09-06 09:32:54 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:31:41.360710528 (187h23m38.040906097s) [upload=164914]: Starting upload
Sep  6 09:31:41.360783447 (187h23m38.040979016s) [upload=164914]: Done starting upload
Sep  6 09:31:41.360862178 (187h23m38.041057747s) [upload=164914]: Uploading segments...
Sep  6 09:31:41.360909148 (187h23m38.041104747s) [upload=164914]: Got next segment. Inline: true
Sep  6 09:31:41.360914728 (187h23m38.041110297s) [upload=164914]: Waiting for error group managing segments...
Sep  6 09:31:41.360984312 (187h23m38.041179881s) [upload=164914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:31:41.360989862 (187h23m38.041185431s) [upload=164914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:31:41.360992587 (187h23m38.041188156s) [upload=164914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:32:39.493273014 (187h24m36.173468573s) [upload=164914]: Done uploading segments...
Sep  6 09:32:39.493295748 (187h24m36.173491317s) [upload=164914]: Upload finished. err: metaclient: context deadline exceeded
Duration: 14.650995323s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX]
duration:
1m0.176149129s
FAIL (2025-09-06 09:32:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 8)
======LOGS======
s:81.171.14.70:4028): protocol: write tcp 188.166.225.170:57784->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:57784->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57784->81.171.14.70:4028: use of closed network connection
Sep  6 09:32:53.088383692 (187h24m49.768579261s) [noise=true , address=185.167.204.205:4033 , piece_id=AXHB2XWOBA77244XM2PTM4N4CIDTYUHFLTXYQQFPOLNYQPAMWEVQ, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, address:185.167.204.205:4033): protocol: write tcp 188.166.225.170:42838->185.167.204.205:4033: use of closed network connection; write tcp 188.166.225.170:42838->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42838->185.167.204.205:4033: use of closed network connection
Sep  6 09:32:53.088436172 (187h24m49.768631742s) [noise=true , address=185.167.204.206:4068 , piece_id=RBI3OZYFJABMLXC2P67D4LKSEF5MB45YSXIMY4GI7RGFX4R6K2PQ, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: read tcp 188.166.225.170:40916->185.167.204.206:4068: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.088511477 (187h24m49.768707046s) [noise=true , address=81.171.14.70:4037    , piece_id=T27Y5FV5FV45UFDG5K6AH2SRGRZWAQ7VGYUQ5EDPSLNNIX3KCBEA, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:50822->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:50822->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50822->81.171.14.70:4037: use of closed network connection
Sep  6 09:32:53.088701801 (187h24m49.76889737s) [noise=true , address=185.167.204.205:4030 , piece_id=OCFHUN3L7NS6LQMW23RDS64HA32LM7DY2T44MGAIYH5YXVUJFNSQ, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: write tcp 188.166.225.170:52630->185.167.204.205:4030: use of closed network connection; write tcp 188.166.225.170:52630->185.167.204.205:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52630->185.167.204.205:4030: use of closed network connection
Sep  6 09:32:53.088765342 (187h24m49.768960911s) [noise=true , address=81.171.14.70:4047    , piece_id=LZAVW6YQAWXDOQR4GYHVKFQMPVTMSUZZNXU6YNL7IY43UCTMXKVQ, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:42208->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:42208->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42208->81.171.14.70:4047: use of closed network connection
Sep  6 09:32:53.088924758 (187h24m49.769120327s) [noise=true , address=185.167.204.205:4021 , piece_id=SJWTVIH2WDUUJZ572E42TLTPWVEH3BVOEK47YYVCX6DLBO76DTKQ, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:59340->185.167.204.205:4021: use of closed network connection; write tcp 188.166.225.170:59340->185.167.204.205:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59340->185.167.204.205:4021: use of closed network connection
Sep  6 09:32:53.088954254 (187h24m49.769149823s) [noise=true , address=185.167.204.206:4038 , piece_id=JKXGJE3PSWVT2CZDW3NCGPO2SCTMZJMTF2PGLB362IZKYZKPSUIA, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 188.166.225.170:50400->185.167.204.206:4038: use of closed network connection; write tcp 188.166.225.170:50400->185.167.204.206:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50400->185.167.204.206:4038: use of closed network connection
Sep  6 09:32:53.088987167 (187h24m49.769182736s) [noise=true , address=185.167.204.205:4034 , piece_id=7OHBTMTDYV6HE3DMCPXD4ICBZV5R6VNZHH4X6536G72KHXNUNU6Q, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: read tcp 188.166.225.170:59634->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089022525 (187h24m49.769218084s) [noise=true , address=185.167.204.205:4027 , piece_id=QIKHJHJIPDID67CUC5GPUHKBCTGIMVAW5UV56TEFOD4Z36M5Q4MQ, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: read tcp 188.166.225.170:36966->185.167.204.205:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089041581 (187h24m49.76923715s) [noise=true , address=185.167.204.205:4036 , piece_id=KAYWCCUC464UKBFH4QYZXYVOR5EERZUIHYI5UUK5TGAGTUU2SAKA, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: read tcp 188.166.225.170:39816->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089084373 (187h24m49.769279942s) [noise=true , address=185.167.204.205:4017 , piece_id=HO66HIRWFLRNM24MKESDHSTPLSGAKWUUHR3PALZVF663K5YOWS3Q, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 188.166.225.170:54554->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089096816 (187h24m49.769292386s) [noise=true , address=185.167.204.205:4004 , piece_id=5K47UMIKBGV32DXUXOICL3K4IMIHHW6G33ZNCUXHVO2HIVK4NRIQ, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 188.166.225.170:53160->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089111365 (187h24m49.769306934s) [noise=true , address=81.171.14.70:4048    , piece_id=KFTVUMYVXMQ3G3KUOC7T7MFLZWPULHLNRN2O4S47DIV4ZRS6AZOA, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: write tcp 188.166.225.170:45672->81.171.14.70:4048: use of closed network connection; write tcp 188.166.225.170:45672->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45672->81.171.14.70:4048: use of closed network connection
Sep  6 09:32:53.089136533 (187h24m49.769332102s) [noise=true , address=81.171.14.70:4035    , piece_id=RDT3HOU35V7MY5DK5FAT6Q6NYUUJYTI7U4LYVGJY6DU3457LOHUA, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: read tcp 188.166.225.170:54006->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089164997 (187h24m49.769360577s) [noise=true , address=185.167.204.206:4053 , piece_id=KL4TFIODYPB5OIR6S2E7LWXKZBBGPS7HXWYVEWDR4PEXD4SG2X3A, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: read tcp 188.166.225.170:41338->185.167.204.206:4053: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089199122 (187h24m49.769394692s) [noise=true , address=185.167.204.205:4022 , piece_id=3IXB6OROBRMSDLPVSALEJF6E75ECS37TA3W7HI3W2ONEREGMOOJA, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: read tcp 188.166.225.170:49826->185.167.204.205:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089246333 (187h24m49.769441902s) [noise=true , address=185.167.204.206:4043 , piece_id=C5AHB4ICU57RDTKJJNC6LBILNWKSYTYI3KQ3XF2TKA5ZXIZ6ELIA, seg_pos={0 0}, upload=164918]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: read tcp 188.166.225.170:58070->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:53.089275158 (187h24m49.769470727s) [seg_pos={0 0}, upload=164918]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil>
Sep  6 09:32:53.261039626 (187h24m49.941235195s) [upload=164918]: Done uploading segments...
Sep  6 09:32:53.261085363 (187h24m49.941280942s) [upload=164918]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8)
Duration: 1m0.176250784s core uplink eu-select-1 eu1-placement-15
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
3 out of 60 is failed (threshold=3) [....................................................X..X..X.]
duration:
13.422289717s
FAIL (2025-09-06 09:32:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 13.42232194s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX]
duration:
31.43940324s
FAIL (2025-09-06 09:32:52 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
g_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:26.404546976 (187h24m23.084742545s) [noise=true , address=77.90.31.10:4518     , piece_id=NVCZQPYN6DCDH62ENDXRZMHKFSPAJ2SDZAKGSCBQTTU3MTL7NAZQ, seg_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:26.404600489 (187h24m23.084796058s) [noise=true , address=45.91.116.9:4262     , piece_id=UVCZCNQA4ZXXTZ5TRC4BGT5KWJTNLDWD6V464CMHJ53P4LJYIA6Q, seg_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:26.404772809 (187h24m23.084968378s) [noise=true , address=77.90.31.19:4841     , piece_id=LJJQ42LZHZB4SJVHCCUSZFP232Q3YDEABEJO7YETURS2B67DF2GQ, seg_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:26.404869133 (187h24m23.085064702s) [noise=true , address=45.91.116.6:4975     , piece_id=WLNBJDSF43CKJER22JLAYP3UF7PJ4UUFFTZPZTRVCDCXM5PHMHDQ, seg_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:26.405001045 (187h24m23.085196614s) [noise=true , address=77.90.31.19:4842     , piece_id=Q546CW2QFVN6E4ARSW2IT56FWTVREELUTYHVXRXMSNAZJCCDGJSQ, seg_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:26.405099895 (187h24m23.085295464s) [noise=true , address=77.90.31.17:4771     , piece_id=P2L6DFHJ6KAQAF25R7JZ5YM3TS6RRWCJZT5GJ434XDJWTIZCPLHA, seg_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:26.405311750 (187h24m23.085507309s) [noise=true , address=45.91.116.4:4940     , piece_id=6663EUQ44HFKYP6IH6QX3ZWYAL4MDSLJU4D7R2VH43XKWKFFTZMQ, seg_pos={0 0}, upload=164923]: Uploading piece...
Sep  6 09:32:51.009556727 (187h24m47.689752297s) [upload=164923]: Next segment err: context deadline exceeded
Sep  6 09:32:51.010175180 (187h24m47.690370749s) [noise=true , address=45.91.116.7:4010     , piece_id=X2MYECIODH7EHT2GZC4LIVKVBKNEH7JJR5ECSRZN62J7YJNNET7Q, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: read tcp 188.166.225.170:43578->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010295591 (187h24m47.69049116s) [noise=true , address=45.91.116.14:4191    , piece_id=4CXXM5NTVH4DYGO3UJMD5QA4YID75DO7SRWWCE4BCWOOXSULOB3A, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 188.166.225.170:34246->45.91.116.14:4191: use of closed network connection; write tcp 188.166.225.170:34246->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34246->45.91.116.14:4191: use of closed network connection
Sep  6 09:32:51.010501154 (187h24m47.690696723s) [noise=true , address=77.90.31.15:4697     , piece_id=XSFX3IWZP2TQHP3WQE6A4YSEXF4ELMSATY7IVNE4YJWPBLSVJU4A, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:42032->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:42032->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42032->77.90.31.15:4697: use of closed network connection
Sep  6 09:32:51.010541071 (187h24m47.69073664s) [noise=true , address=45.91.116.13:4154    , piece_id=GCVPEK6ON3CIG6Y5OMNIA3UXQ7HSVMMZTAP5XERK34E3KAKXELCA, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 188.166.225.170:48476->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010577530 (187h24m47.690773099s) [noise=true , address=77.90.31.10:4518     , piece_id=NVCZQPYN6DCDH62ENDXRZMHKFSPAJ2SDZAKGSCBQTTU3MTL7NAZQ, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 188.166.225.170:50456->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010609321 (187h24m47.69080488s) [noise=true , address=77.90.31.12:4589     , piece_id=XXOHO7CODJXNNMIHJJQTI5PKRPIOPHGKVYU5UVXYZSIW7VBSJZGA, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 188.166.225.170:56322->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010640300 (187h24m47.690835869s) [noise=true , address=45.91.116.8:4045     , piece_id=2M6L24ASMUH23M3GAHOVJJTFN5JLOGCTWZ7AL2L5S3E4XGOK43LQ, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: read tcp 188.166.225.170:37344->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010646051 (187h24m47.69084162s) [noise=true , address=45.91.116.5:4298     , piece_id=LYAWNBUVEQKCJQMRG265CEKCJ3CYNEJ77743QALF63YMFMCO5AQA, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:52238->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:52238->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52238->45.91.116.5:4298: use of closed network connection
Sep  6 09:32:51.010656021 (187h24m47.69085159s) [noise=true , address=45.91.116.5:4297     , piece_id=DCHSV6Q7SUXN2N5XBPW3J42XC66MPPPGZRCBAV5UGAJ27XNDFG4Q, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 188.166.225.170:58512->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010679987 (187h24m47.690875556s) [noise=true , address=77.90.31.19:4841     , piece_id=LJJQ42LZHZB4SJVHCCUSZFP232Q3YDEABEJO7YETURS2B67DF2GQ, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:51562->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010697069 (187h24m47.690892638s) [noise=true , address=45.91.116.9:4263     , piece_id=CMF3OYY2YZ54KV3IS2EQIXQIXSQHPSYP3NIDBWENDCXBC63XNOSA, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: read tcp 188.166.225.170:55594->45.91.116.9:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010714723 (187h24m47.690910292s) [noise=true , address=45.91.116.6:4975     , piece_id=WLNBJDSF43CKJER22JLAYP3UF7PJ4UUFFTZPZTRVCDCXM5PHMHDQ, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 188.166.225.170:38190->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010724331 (187h24m47.6909199s) [noise=true , address=77.90.31.19:4842     , piece_id=Q546CW2QFVN6E4ARSW2IT56FWTVREELUTYHVXRXMSNAZJCCDGJSQ, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:43202->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:43202->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43202->77.90.31.19:4842: use of closed network connection
Sep  6 09:32:51.010736104 (187h24m47.690931673s) [noise=true , address=45.91.116.9:4262     , piece_id=UVCZCNQA4ZXXTZ5TRC4BGT5KWJTNLDWD6V464CMHJ53P4LJYIA6Q, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 188.166.225.170:58016->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010752254 (187h24m47.690947813s) [noise=true , address=77.90.31.17:4771     , piece_id=P2L6DFHJ6KAQAF25R7JZ5YM3TS6RRWCJZT5GJ434XDJWTIZCPLHA, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:45736->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010772644 (187h24m47.690968213s) [noise=true , address=45.91.116.4:4940     , piece_id=6663EUQ44HFKYP6IH6QX3ZWYAL4MDSLJU4D7R2VH43XKWKFFTZMQ, seg_pos={0 0}, upload=164923]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: read tcp 188.166.225.170:38990->45.91.116.4:4940: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:51.010808712 (187h24m47.691004281s) [seg_pos={0 0}, upload=164923]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 31.439425784s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX]
duration:
1m0.000774804s
FAIL (2025-09-06 09:32:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000830251s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX]
duration:
10.415824743s
FAIL (2025-09-06 09:32:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 10.415851343s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [.................................................X..X....X.X]
duration:
30.174746562s
FAIL (2025-09-06 09:32:49 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 47)
Duration: 30.174772612s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.....................................................XX...XX]
duration:
1m0.000811421s
FAIL (2025-09-06 09:32:39 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:31:41.360710528 (187h23m38.040906097s) [upload=164914]: Starting upload
Sep  6 09:31:41.360783447 (187h23m38.040979016s) [upload=164914]: Done starting upload
Sep  6 09:31:41.360862178 (187h23m38.041057747s) [upload=164914]: Uploading segments...
Sep  6 09:31:41.360909148 (187h23m38.041104747s) [upload=164914]: Got next segment. Inline: true
Sep  6 09:31:41.360914728 (187h23m38.041110297s) [upload=164914]: Waiting for error group managing segments...
Sep  6 09:31:41.360984312 (187h23m38.041179881s) [upload=164914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:31:41.360989862 (187h23m38.041185431s) [upload=164914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:31:41.360992587 (187h23m38.041188156s) [upload=164914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:32:39.493273014 (187h24m36.173468573s) [upload=164914]: Done uploading segments...
Sep  6 09:32:39.493295748 (187h24m36.173491317s) [upload=164914]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.000822092s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [......................................................XXXXXX]
duration:
1m8.141596435s
FAIL (2025-09-06 09:32:34 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
0:4386   , piece_id=44A3MY3LZHEWAUZ5JOKPUTGP57M5DJWNE5ZDLYUQKEJQ5U6UUFGA, seg_pos={0 0}, upload=164913]: Uploading piece...
Sep  6 09:31:51.620560775 (187h23m48.300756354s) [noise=true , address=77.90.31.17:4787     , piece_id=NZPO5QYGLEMJ44YUUER5AZUVWCHF5AE5JT5L6TIODFNPMFTA3ARA, seg_pos={0 0}, upload=164913]: Uploading piece...
Sep  6 09:32:26.579505175 (187h24m23.259700734s) [upload=164913]: Next segment err: context deadline exceeded
Sep  6 09:32:26.579944926 (187h24m23.260140485s) [noise=true , address=45.91.116.5:4322     , piece_id=2HWVH3QLLA34PNOBC7R6574MZRB7K7SXHFK7WXF7IAEIMBQPVYUA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:12W3qDq8BssS8V6osW9NwFHZHMJcCRfjYP8qKwphE5SenVewWXy, address:45.91.116.5:4322): protocol: write tcp 188.166.225.170:45840->45.91.116.5:4322: use of closed network connection; write tcp 188.166.225.170:45840->45.91.116.5:4322: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45840->45.91.116.5:4322: use of closed network connection
Sep  6 09:32:26.579995503 (187h24m23.260191072s) [noise=true , address=145.79.227.37:4570   , piece_id=UPEKDGEMVHLO6QJQHD2GLV54BXBRQGH5BAAP7XABT5YJILCKMXTA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: write tcp 188.166.225.170:38956->145.79.227.37:4570: use of closed network connection; write tcp 188.166.225.170:38956->145.79.227.37:4570: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38956->145.79.227.37:4570: use of closed network connection
Sep  6 09:32:26.580028246 (187h24m23.260223805s) [noise=true , address=145.79.227.40:4080   , piece_id=NRLCNVDQ45R44HEKN3V57AJXYGQFPNOCKDSKRKRWQ6IFB5HJEV3A, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C, address:145.79.227.40:4080): protocol: write tcp 188.166.225.170:34824->145.79.227.40:4080: use of closed network connection; write tcp 188.166.225.170:34824->145.79.227.40:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34824->145.79.227.40:4080: use of closed network connection
Sep  6 09:32:26.580166461 (187h24m23.26036203s) [noise=true , address=145.79.227.13:4813   , piece_id=ML6SBYNDBSZ3NZHCKRPUOIQGB2DD5XNAWRT6M64KPRSEISTSGH4A, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:12EHHTcQmhaHswSx1ubyHmPTHBB5ptuxmydbKHLjYChF1mudMSB, address:145.79.227.13:4813): protocol: write tcp 188.166.225.170:36338->145.79.227.13:4813: use of closed network connection; write tcp 188.166.225.170:36338->145.79.227.13:4813: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36338->145.79.227.13:4813: use of closed network connection
Sep  6 09:32:26.580196739 (187h24m23.260392308s) [noise=true , address=145.79.227.27:4717   , piece_id=33TFE4GMNAOVDPOJNRKQYFYHKZCKHJ7W3MJUUK2CKDBH2PTPXMLQ, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1RoaiSQRUzHDCaEpesf243MzR9ieZnn9rzbbwwEBmhgboptFnq, address:145.79.227.27:4717): protocol: write tcp 188.166.225.170:58100->145.79.227.27:4717: use of closed network connection; write tcp 188.166.225.170:58100->145.79.227.27:4717: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58100->145.79.227.27:4717: use of closed network connection
Sep  6 09:32:26.580378826 (187h24m23.260574385s) [noise=true , address=145.79.227.43:4180   , piece_id=2ZEDIXKB3IGWMGEUXUKG56MSTR5HHBHL2NKT5EN3ANOC4KXRDSUQ, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1rhkcipPBZNFScBjBhWdigzSMwENSmzhCucnC2iuyc9udpweE3, address:145.79.227.43:4180): protocol: read tcp 188.166.225.170:57166->145.79.227.43:4180: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580409987 (187h24m23.260605556s) [noise=true , address=145.79.227.2:4125    , piece_id=R6PPLC4HH57E2F7BKVGERYVF6JDL3WI34SO4PSQ366ECXUJ2HMSA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:145.79.227.2:4125): protocol: read tcp 188.166.225.170:54336->145.79.227.2:4125: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580448600 (187h24m23.260644169s) [noise=true , address=145.79.227.35:4498   , piece_id=HCHBSFIMD7C2MAW77HOAMQUXBGFRGYSXA6V3ZNBJPC2OXI3XUHVA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4, address:145.79.227.35:4498): protocol: read tcp 188.166.225.170:47232->145.79.227.35:4498: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580485961 (187h24m23.26068153s) [noise=true , address=77.90.31.17:4787     , piece_id=NZPO5QYGLEMJ44YUUER5AZUVWCHF5AE5JT5L6TIODFNPMFTA3ARA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: read tcp 188.166.225.170:47326->77.90.31.17:4787: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580493466 (187h24m23.260689036s) [noise=true , address=145.79.227.5:4244    , piece_id=OJSI4YA2KNWRBIF2KCNY2AEE73U5P27E7VUNLBXCZLLOYJ6AGLOA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:129iVGvtfYzqdPJk52ef8uGNHKp1jJtr2MGE4uXq8oKQmmXX6C, address:145.79.227.5:4244): protocol: read tcp 188.166.225.170:52388->145.79.227.5:4244: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580514235 (187h24m23.260709805s) [noise=true , address=145.79.227.50:4386   , piece_id=44A3MY3LZHEWAUZ5JOKPUTGP57M5DJWNE5ZDLYUQKEJQ5U6UUFGA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: read tcp 188.166.225.170:37828->145.79.227.50:4386: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580534004 (187h24m23.260729573s) [noise=true , address=45.91.116.7:4044     , piece_id=F3LRCL5D7CLY4UICAR3ZP74Q63AZRI4SZX3XWVVZ7X3YRNWFRW7A, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:12b9DdnzjhU7zj2RSCba3ZWS7AZbZZ4YmDDF4QRq6dZC6YfskNz, address:45.91.116.7:4044): protocol: read tcp 188.166.225.170:33148->45.91.116.7:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580562718 (187h24m23.260758278s) [noise=true , address=145.79.227.14:4870   , piece_id=EYR2SIHFD2VRQ35K3UG64EU6FSSG6JY7FUKPHQNDEOYM4GFNVCQA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: read tcp 188.166.225.170:56312->145.79.227.14:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580583949 (187h24m23.260779558s) [noise=true , address=145.79.227.40:4067   , piece_id=4QX74ZP5VD4XIMOGZVPK657GPQ77XF2DLZBGIEZQFCQRCZCQ7VJA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq, address:145.79.227.40:4067): protocol: read tcp 188.166.225.170:37068->145.79.227.40:4067: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580604679 (187h24m23.260800248s) [noise=true , address=145.79.227.4:4195    , piece_id=XUYGLHUXZYLO43Z5N7JFF5FMH74GEWVXV4WKP7FVROONIDZPVU7Q, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:12mmoBC7kBL5PVuzYvsq8Qb2kFNJNWQBTSCVq6xjkeyJxXPdPBH, address:145.79.227.4:4195): protocol: read tcp 188.166.225.170:52046->145.79.227.4:4195: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580623835 (187h24m23.260819414s) [noise=true , address=145.79.227.49:4342   , piece_id=DWNBFNGFVOND4GV2B7PVQETS4YMK6ABG2AP3UWKKDZTMCJWWHWTA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: read tcp 188.166.225.170:38630->145.79.227.49:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580646940 (187h24m23.260842509s) [noise=true , address=77.90.31.18:4815     , piece_id=33AJRQ2BHRIQTSECCCTB5ODNYELH4K7DYMXNDI6PW7SQ5DGB3IYA, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: read tcp 188.166.225.170:52454->77.90.31.18:4815: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580664173 (187h24m23.260859742s) [noise=true , address=145.79.227.47:4269   , piece_id=3I3H5S6ON7FGXAJE62AR5ZQHYBAHRCKSIJTLCLOQHHYOYITSECBQ, seg_pos={0 0}, upload=164913]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: read tcp 188.166.225.170:38856->145.79.227.47:4269: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:32:26.580680994 (187h24m23.260876574s) [seg_pos={0 0}, upload=164913]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 1m8.14160948s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
1.891417351s
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 09:32:32 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 1.891456626s edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX]
duration:
25.748166285s
FAIL (2025-09-06 09:32:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 25.74819557s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
3 out of 60 is failed (threshold=3) [.....................................................X..X..X]
duration:
30.001177617s
FAIL (2025-09-06 09:32:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.001193497s edge authservice http us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
3 out of 60 is failed (threshold=3) [.....................................................XXX....]
duration:
26.196531408s
target:
https://us1.storj.io/login
FAIL (2025-09-06 09:32:28 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 26.196564171s core satellite us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
4.314474566s
FAIL (2025-09-06 09:32:25 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 46)
Duration: 4.314502691s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
58.08112555s
remote:
"tcp:45.38.24.2:443"
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-09-06 09:32:25 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 58.081139568s edge gateway vhost us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001192361s
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 09:32:11 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 30.001231115s edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX]
duration:
30.000765805s
FAIL (2025-09-06 09:32:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000786503s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
7 out of 60 is failed (threshold=3) [................................................XXXXXX.....X]
duration:
30.000949685s
FAIL (2025-09-06 09:32:07 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:31:53.316386893 (187h23m49.996582462s) [upload=164917]: Starting upload
Sep  6 09:31:53.316447209 (187h23m49.996642778s) [upload=164917]: Done starting upload
Sep  6 09:31:53.316505841 (187h23m49.9967014s) [upload=164917]: Uploading segments...
Sep  6 09:31:53.316547400 (187h23m49.996742969s) [upload=164917]: Got next segment. Inline: true
Sep  6 09:31:53.316551348 (187h23m49.996746917s) [upload=164917]: Waiting for error group managing segments...
Sep  6 09:31:53.316588109 (187h23m49.996783668s) [upload=164917]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:31:53.316592767 (187h23m49.996788377s) [upload=164917]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:31:53.316598689 (187h23m49.996794278s) [upload=164917]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:32:07.926944962 (187h24m4.607140532s) [upload=164917]: Done uploading segments...
Sep  6 09:32:07.926966684 (187h24m4.607162253s) [upload=164917]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000970955s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
2 out of 60 is failed (threshold=3) [......................................................X..X..]
duration:
36.923069043s
FAIL (2025-09-06 09:32:00 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 36.923102086s edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX]
duration:
30.001315529s
FAIL (2025-09-06 09:31:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001337792s edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
3.559630511s
FAIL (2025-09-06 09:31:58 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 46)
Duration: 3.559663713s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
6 out of 60 is failed (threshold=3) [.................................................X.X.X.X.XX.]
duration:
11.629697664s
FAIL (2025-09-06 09:31:56 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 11.629731128s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX]
duration:
1m0.172775487s
FAIL (2025-09-06 09:31:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 7)
======LOGS======
use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58710->185.167.204.205:4008: use of closed network connection
Sep  6 09:31:52.652735050 (187h23m49.332930619s) [noise=true , address=185.167.204.206:4052 , piece_id=MGZXLSXGDRJYLREXTZAISIFLEU4SFUMBBTIOOL4JJLVW4AYPBAXA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: write tcp 188.166.225.170:41034->185.167.204.206:4052: use of closed network connection; write tcp 188.166.225.170:41034->185.167.204.206:4052: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41034->185.167.204.206:4052: use of closed network connection
Sep  6 09:31:52.652854438 (187h23m49.333050007s) [noise=true , address=81.171.14.70:4044    , piece_id=L4LE4ASE3TZMXQEYMYXM4VKSTFWA3Q33SABQEJDLN4TOIKSZBV2Q, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: write tcp 188.166.225.170:42428->81.171.14.70:4044: use of closed network connection; write tcp 188.166.225.170:42428->81.171.14.70:4044: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42428->81.171.14.70:4044: use of closed network connection
Sep  6 09:31:52.652904013 (187h23m49.333099583s) [noise=true , address=81.171.14.70:4035    , piece_id=JWNSSLS5QAMX3YFDPBTD4LOPNJIOK4M5QB2ZYYVFPNLDB2I2Z3TQ, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:48410->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:48410->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48410->81.171.14.70:4035: use of closed network connection
Sep  6 09:31:52.652955192 (187h23m49.333150761s) [noise=true , address=185.167.204.205:4022 , piece_id=GYS3NIWQMZ5HZOU4IWNDNBJZCNWVQVFAPT2YIPN3OSCG35JRX6NA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: read tcp 188.166.225.170:47012->185.167.204.205:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653006350 (187h23m49.333201919s) [noise=true , address=81.171.14.70:4032    , piece_id=QSXBWWTJ4P5DT2WV5UL33TOR7V2REYDDA6YT33MFNQ5GXT4RJKOQ, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:59024->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:59024->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59024->81.171.14.70:4032: use of closed network connection
Sep  6 09:31:52.653224146 (187h23m49.333419725s) [noise=true , address=81.171.14.70:4026    , piece_id=UWP65YZA7CWPJEKYX6BYYPJHR5ULY7SRAWEPBFLHVCQZYNLRAH5Q, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: read tcp 188.166.225.170:40386->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653270725 (187h23m49.333466294s) [noise=true , address=185.167.204.205:4017 , piece_id=TTMNLS3FC6W5ZHSF65X4XDM2LHHK4SKT2SL2AEH3DNLBP6G34QHQ, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 188.166.225.170:52556->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653278340 (187h23m49.333473919s) [noise=true , address=185.167.204.206:4064 , piece_id=CDBOIZZFJEE23GQTYHPW4DJVDEKLCGKDBMC5MFPCWAT4SEOXQBCQ, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: write tcp 188.166.225.170:47308->185.167.204.206:4064: use of closed network connection; write tcp 188.166.225.170:47308->185.167.204.206:4064: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47308->185.167.204.206:4064: use of closed network connection
Sep  6 09:31:52.653321432 (187h23m49.333517001s) [noise=true , address=81.171.14.70:4048    , piece_id=Q236HNNUXJLSPNZFX3OSCLBTZT4WQ4QN6USOBZAEV2BSSD6ZGLTA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: read tcp 188.166.225.170:37832->81.171.14.70:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653366398 (187h23m49.333561977s) [noise=true , address=185.167.204.205:4015 , piece_id=UGHSMW5AFVB7BK2ETYASGRLDJLRUPBZAAJIJYWNMJWOSRCEOWE5A, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 188.166.225.170:52234->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653423658 (187h23m49.333619227s) [noise=true , address=81.171.14.70:4047    , piece_id=63QWKC22A34LIGIM4IRHREKQKSCLH7L5RBKRW44YRSBCVFVYVKUA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:58032->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653463153 (187h23m49.333658722s) [noise=true , address=81.171.14.70:4046    , piece_id=IVTJKETWPFG2ER43FT2E2D4TXRO2QIOY5SWGBXZPRXECXLTVEVIA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:44776->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653469987 (187h23m49.333665556s) [noise=true , address=185.167.204.206:4041 , piece_id=GZYHD6JHLACESPPSO7N2Q4ZEWFMRBCTSUYKVS2IVR2EAMWZWFRJQ, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: read tcp 188.166.225.170:56184->185.167.204.206:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653522878 (187h23m49.333718447s) [noise=true , address=81.171.14.70:4031    , piece_id=NZPSVAETYS2MPMY3WCICZ4ZUG2SCBMILG7PLUSOXK5BAV47ZPXFA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: read tcp 188.166.225.170:38614->81.171.14.70:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653529190 (187h23m49.333724759s) [noise=true , address=185.167.204.206:4058 , piece_id=43E2VKKCYSVTRHA5TRBY6WHKFXUP5FKIRQCJ3OKTRNIP36ZGZGTA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: read tcp 188.166.225.170:41870->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653550411 (187h23m49.33374599s) [noise=true , address=81.171.14.70:4039    , piece_id=DKXTCLAANBANV3XA3J2BXE6D4HW6SS4AGVFBYFY34TS6PSWZ464A, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: read tcp 188.166.225.170:43802->81.171.14.70:4039: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653577803 (187h23m49.333773372s) [noise=true , address=185.167.204.206:4070 , piece_id=GKZXNXH2Q4VRKQC4MLJPCCEA2FLL77CJXH7LZ7MHM5DMFK5CMIFA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: read tcp 188.166.225.170:34836->185.167.204.206:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653595677 (187h23m49.333791246s) [noise=true , address=185.167.204.206:4038 , piece_id=BZS3B3SWHOKXVXMJOHQFLMNSDMNY5KDRGHETPWO3SHTOW56BOENA, seg_pos={0 0}, upload=164906]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: read tcp 188.166.225.170:37908->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:52.653638329 (187h23m49.333833898s) [seg_pos={0 0}, upload=164906]: Done waiting for segment. successful: 7 optimal: 26 errs: <nil>
Sep  6 09:31:52.823899640 (187h23m49.50409521s) [upload=164906]: Done uploading segments...
Sep  6 09:31:52.823926472 (187h23m49.504122041s) [upload=164906]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 7)
Duration: 1m0.172788592s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX]
duration:
1m0.000767444s
FAIL (2025-09-06 09:31:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000779897s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
3 out of 60 is failed (threshold=3) [......................................................XXX...]
duration:
6.820102105s
target:
https://us1.storj.io/login
FAIL (2025-09-06 09:31:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 6.820134085s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
6 out of 60 is failed (threshold=3) [..................................................X.X.X.X.XX]
duration:
30.000453882s
FAIL (2025-09-06 09:31:44 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 30.000481385s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX]
duration:
30.001444669s
FAIL (2025-09-06 09:31:41 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 30.001464317s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
3 out of 60 is failed (threshold=3) [......................................................XX...X]
duration:
1m0.000855522s
FAIL (2025-09-06 09:31:39 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:30:54.339701500 (187h22m51.01989707s) [upload=164907]: Starting upload
Sep  6 09:30:54.339755434 (187h22m51.019951013s) [upload=164907]: Done starting upload
Sep  6 09:30:54.339804086 (187h22m51.019999655s) [upload=164907]: Uploading segments...
Sep  6 09:30:54.339839404 (187h22m51.020034973s) [upload=164907]: Got next segment. Inline: true
Sep  6 09:30:54.339842771 (187h22m51.02003834s) [upload=164907]: Waiting for error group managing segments...
Sep  6 09:30:54.339874261 (187h22m51.02006983s) [upload=164907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:30:54.339878348 (187h22m51.020073917s) [upload=164907]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:30:54.339880923 (187h22m51.020076492s) [upload=164907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:31:39.231211150 (187h23m35.911406729s) [upload=164907]: Done uploading segments...
Sep  6 09:31:39.231232951 (187h23m35.91142852s) [upload=164907]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.000881912s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
4.406823645s
FAIL (2025-09-06 09:31:33 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 46)
Duration: 4.406855677s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX]
duration:
30.00075137s
FAIL (2025-09-06 09:31:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.000778212s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
2m0.000926003s
remote:
"tcp:45.38.24.2:443"
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-09-06 09:31:27 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 2m0.000947192s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.......................................................XXXXX]
duration:
1m1.386413098s
FAIL (2025-09-06 09:31:26 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
9.227.3:4159    , piece_id=RZTZZWLSTQP3FCVLRI4F43YVYFMFKCBX7XRLUC3SFL7BT75PCUOQ, seg_pos={0 0}, upload=164903]: Uploading piece...
Sep  6 09:30:41.347286488 (187h22m38.027482057s) [noise=true , address=77.90.31.16:4768     , piece_id=PBAOJTLXHGTMKAEYYRVNLOGDP4TUZQEHBF3ANK4V3LCNJ55ZTU5Q, seg_pos={0 0}, upload=164903]: Uploading piece...
Sep  6 09:30:41.347495819 (187h22m38.027691398s) [noise=true , address=77.90.31.15:4712     , piece_id=ECXAFJSCKSBSNQHTGEBKZ5XMRDGDCTNSDW6NL5KFRWVDGMU3U63Q, seg_pos={0 0}, upload=164903]: Uploading piece...
Sep  6 09:30:41.347800521 (187h22m38.027996091s) [noise=true , address=145.79.227.14:4865   , piece_id=2EFHUPRHL7FLZ4TVLA5OTHNX5E3UIM4VOWWNCT2K2SEQQXGNDYFA, seg_pos={0 0}, upload=164903]: Uploading piece...
Sep  6 09:31:24.934310058 (187h23m21.614505617s) [upload=164903]: Next segment err: context deadline exceeded
Sep  6 09:31:24.935229828 (187h23m21.615425397s) [noise=true , address=145.79.227.50:4389   , piece_id=B5LT2DTEI6JKT2CQ5AXX3BM7A7SQOQRPOV4EZ4OBIJ5OWOE7FS3Q, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ, address:145.79.227.50:4389): protocol: read tcp 188.166.225.170:38740->145.79.227.50:4389: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935290334 (187h23m21.615485893s) [noise=true , address=145.79.227.37:4581   , piece_id=GUTYNH7BODWQ66DG5ZKRI7EAZQY2EDXZEFE773EAO663K7JYII2Q, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:12HmLrxBgUMLd1hJ9W1hf4zGjJccCwXubt46XkdDGduwgK7R6V6, address:145.79.227.37:4581): protocol: read tcp 188.166.225.170:50882->145.79.227.37:4581: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935325832 (187h23m21.615521391s) [noise=true , address=145.79.227.3:4159    , piece_id=RZTZZWLSTQP3FCVLRI4F43YVYFMFKCBX7XRLUC3SFL7BT75PCUOQ, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1taQkf86SDCwKJaXVcfu1YcSNz8SfpAtChruvcZVFfy55qZdtX, address:145.79.227.3:4159): protocol: read tcp 188.166.225.170:42256->145.79.227.3:4159: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935375096 (187h23m21.615570665s) [noise=true , address=145.79.227.48:4319   , piece_id=XCSACKQM6BPNJF55PCWKXDXL2EHEQKEVWKBQL5JMWFYFL4VUVBBQ, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK, address:145.79.227.48:4319): protocol: read tcp 188.166.225.170:55984->145.79.227.48:4319: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935414963 (187h23m21.615610532s) [noise=true , address=145.79.227.15:4904   , piece_id=BI3GDJHS7TRNPMDEQDJHIGLCVESUB4I75DAXPCXPP4UJGEHCNVJQ, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1y8S5sEV2o6s823Jb5f11EmDHGbQaFkWZ18k9TCii3TR5vRt9y, address:145.79.227.15:4904): protocol: read tcp 188.166.225.170:45810->145.79.227.15:4904: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935446012 (187h23m21.615641581s) [noise=true , address=145.79.227.6:4288    , piece_id=IW3V64D2PMVS4QZFXZR6I4C2X3U6S64DIMRZLHZKXBPXTJVHEIPA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7, address:145.79.227.6:4288): protocol: read tcp 188.166.225.170:50746->145.79.227.6:4288: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935479436 (187h23m21.615675005s) [noise=true , address=145.79.227.14:4865   , piece_id=2EFHUPRHL7FLZ4TVLA5OTHNX5E3UIM4VOWWNCT2K2SEQQXGNDYFA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL, address:145.79.227.14:4865): protocol: read tcp 188.166.225.170:36696->145.79.227.14:4865: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935510425 (187h23m21.615705994s) [noise=true , address=145.79.227.13:4828   , piece_id=M63Q6CSG7U55IL35A5K73N6Z4GTZXHOS2TGD2TYPME3MBM4DAABA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ, address:145.79.227.13:4828): protocol: read tcp 188.166.225.170:57702->145.79.227.13:4828: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935547667 (187h23m21.615743236s) [noise=true , address=77.90.31.21:4910     , piece_id=JJWZ54HJBI2OQILX5BNSJJTOZO5HF472OFKNMWTGBUD67ZTI6OTA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:12onFkiP1wSRcNuzyqegL2EjfttSrQ5AMJwfp9PBn5urHQb3C2H, address:77.90.31.21:4910): protocol: read tcp 188.166.225.170:38470->77.90.31.21:4910: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935612731 (187h23m21.61580829s) [noise=true , address=145.79.227.5:4228    , piece_id=44DH34YIH4AESLD7XT2NQKMPAWXBIJLYABBGOGK53L4ATQIAQQLQ, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF, address:145.79.227.5:4228): protocol: write tcp 188.166.225.170:49208->145.79.227.5:4228: use of closed network connection; write tcp 188.166.225.170:49208->145.79.227.5:4228: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49208->145.79.227.5:4228: use of closed network connection
Sep  6 09:31:24.935640714 (187h23m21.615836283s) [noise=true , address=77.90.31.15:4712     , piece_id=ECXAFJSCKSBSNQHTGEBKZ5XMRDGDCTNSDW6NL5KFRWVDGMU3U63Q, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1bfFfSGARVArNEgchuNzxf7j1QzNbq84fuac8TRfzzsuGGCeT8, address:77.90.31.15:4712): protocol: read tcp 188.166.225.170:59238->77.90.31.15:4712: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935718002 (187h23m21.615913571s) [noise=true , address=145.79.227.36:4524   , piece_id=DAH23FLO5WRCKFYXA54Y3PW2BL3D5QRKWNM6V5KHP7WJFKQ2ZNLA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1xfbCzjSwFDRrR1gPggeN8tNCLbRRWDVzCJ6mqhZsbVSe8d4s4, address:145.79.227.36:4524): protocol: write tcp 188.166.225.170:47624->145.79.227.36:4524: use of closed network connection; write tcp 188.166.225.170:47624->145.79.227.36:4524: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47624->145.79.227.36:4524: use of closed network connection
Sep  6 09:31:24.935854674 (187h23m21.616050243s) [noise=true , address=77.90.31.17:4796     , piece_id=OJBBXO7UP77DAA2ZFTD4KHWAOFRNN4YNU3HOTZWARMHVQGZZKIQA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1KK6y5NBuZovne8n3gMvAyDcZFasZxDzorvPeHe7CefoFs27UF, address:77.90.31.17:4796): protocol: read tcp 188.166.225.170:36920->77.90.31.17:4796: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935892476 (187h23m21.616088045s) [noise=true , address=145.79.227.5:4238    , piece_id=2VJIJPVEZWP3VH53QHHADN25VEYDHAOZV3Z4ZBOK43FHFGA72E4Q, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:122AVjaN3YaiABnUjuZwSb6apPDeszZAWvmzwtP47k1fxsKLD5V, address:145.79.227.5:4238): protocol: read tcp 188.166.225.170:54032->145.79.227.5:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935929938 (187h23m21.616125507s) [noise=true , address=145.79.227.17:4998   , piece_id=QOGLFBYBQW2AZC2EE4RQNPLHAX2GQKB7ONXQHLYXI4ZZYW4W2LRA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:12m8BAEezShMZxBdiwdLhUD6FVbQfDdaFmNDkdM1mKC4WYsidMR, address:145.79.227.17:4998): protocol: read tcp 188.166.225.170:47214->145.79.227.17:4998: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935958813 (187h23m21.616154382s) [noise=true , address=145.79.227.33:4878   , piece_id=7ODDWPT5SVVC57JPO4T7J3QCDAL5EIP7JEKAVCRNZN7TXSQBC64A, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y, address:145.79.227.33:4878): protocol: read tcp 188.166.225.170:59268->145.79.227.33:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.935997547 (187h23m21.616193146s) [noise=true , address=145.79.227.33:4882   , piece_id=OXFM5IU3W5IUTJNXCMGC36YDJ2HKESQ2MNUVMSFGKMPBEJ2QIMTA, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: read tcp 188.166.225.170:58338->145.79.227.33:4882: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.936022996 (187h23m21.616218565s) [noise=true , address=77.90.31.16:4768     , piece_id=PBAOJTLXHGTMKAEYYRVNLOGDP4TUZQEHBF3ANK4V3LCNJ55ZTU5Q, seg_pos={0 0}, upload=164903]: Done uploading piece. err: ecclient: upload failed (node:12UchewmtxBrtSZSpVAJFdZmcTsQVQxkjK9re6cgUGqDhyonQeF, address:77.90.31.16:4768): protocol: read tcp 188.166.225.170:52904->77.90.31.16:4768: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:24.936066179 (187h23m21.616261748s) [seg_pos={0 0}, upload=164903]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 1m1.386425212s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X..X.]
duration:
9.353635956s
FAIL (2025-09-06 09:31:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 9.353657357s edge authservice http us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [..................................................X..X....X.]
duration:
5.604797268s
FAIL (2025-09-06 09:31:11 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 47)
Duration: 5.604828559s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX]
duration:
32.345789175s
FAIL (2025-09-06 09:31:10 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.761146281 (187h22m42.44134185s) [noise=true , address=45.91.116.6:4975     , piece_id=X7O3X3BRS5FBY6XHUGAAGFONFBAMFF3UW34N7AYS34GCTT5CPWEA, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.761167973 (187h22m42.441363542s) [noise=true , address=77.90.31.19:4843     , piece_id=HCKVQFL6HRKNGNF645LO5S5CI7QKFWGYWJJRWCBRQT5WE2YGFV6Q, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.761457527 (187h22m42.441653096s) [noise=true , address=45.91.116.10:4081    , piece_id=F3YZ46LGAIQ32TLZ4PK4DNBUD2RN4HB7HM55HAHYFNQVCXQ4K72Q, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.761464871 (187h22m42.44166043s) [noise=true , address=45.91.116.6:4973     , piece_id=XJXKZ5DQNPLNFHGLF3VAAS5EIXBR7GACVXRQXXCD4OPQYD76IPBA, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.761742643 (187h22m42.441938212s) [noise=true , address=45.91.116.13:4155    , piece_id=NSQZGVADPYIFSC7H5DWLZDMCRNIV4YOF33U6PHAHFEL34SPPYKTA, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.761993422 (187h22m42.442188991s) [noise=true , address=45.91.116.9:4263     , piece_id=HMAQVI545EY6KNGX7G35TXUZP6BOUJI23ABYU2E25IAAGMVB6MWA, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.762010335 (187h22m42.442205904s) [noise=true , address=45.91.116.14:4190    , piece_id=NS4BXRQBBGBYLWQ4QI76R2YG6JQXJUXKR4B2DVVXGWDSHRECWVVA, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.762281995 (187h22m42.442477564s) [noise=true , address=77.90.31.21:4878     , piece_id=6AUKIWEVQHXXWLCLF7P7X52Q6V3OXAYCMP2JH36OHYANQ4Z4OMNQ, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:30:45.762357058 (187h22m42.442552627s) [noise=true , address=45.91.116.10:4083    , piece_id=KFCWYQETOI3RPWXAI4MJ5AREP2JG6XU27GN5RRFBPEOYLW23VKKA, seg_pos={0 0}, upload=164904]: Uploading piece...
Sep  6 09:31:08.068308301 (187h23m4.74850387s) [upload=164904]: Next segment err: context deadline exceeded
Sep  6 09:31:08.068688960 (187h23m4.748884529s) [noise=true , address=77.90.31.19:4843     , piece_id=HCKVQFL6HRKNGNF645LO5S5CI7QKFWGYWJJRWCBRQT5WE2YGFV6Q, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: read tcp 188.166.225.170:38248->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.068735279 (187h23m4.748930858s) [noise=true , address=77.90.31.17:4771     , piece_id=6WLKCBRLOJYETJ7R5MSJ6TYRTGGGBKR57FPCIGM34O6IDPKBWJHQ, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:56554->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.068784653 (187h23m4.748980223s) [noise=true , address=77.90.31.16:4735     , piece_id=K2GR66KD7UOZEB34JQTZHTY44SOOW55DDZFZSCQSBH6EBREWKYOA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 188.166.225.170:42488->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.068853956 (187h23m4.749049535s) [noise=true , address=77.90.31.15:4698     , piece_id=W2FAKAQIAKH3JIZ6AEXJJBUJEOESSRPR5M6QZY5LHALSAQOUSMGQ, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:37556->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:37556->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37556->77.90.31.15:4698: use of closed network connection
Sep  6 09:31:08.069037527 (187h23m4.749233096s) [noise=true , address=45.91.116.13:4155    , piece_id=NSQZGVADPYIFSC7H5DWLZDMCRNIV4YOF33U6PHAHFEL34SPPYKTA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 188.166.225.170:35210->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069109505 (187h23m4.749305074s) [noise=true , address=77.90.31.21:4878     , piece_id=6AUKIWEVQHXXWLCLF7P7X52Q6V3OXAYCMP2JH36OHYANQ4Z4OMNQ, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 188.166.225.170:51574->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069152036 (187h23m4.749347605s) [noise=true , address=45.91.116.10:4083    , piece_id=KFCWYQETOI3RPWXAI4MJ5AREP2JG6XU27GN5RRFBPEOYLW23VKKA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:53830->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069190841 (187h23m4.74938641s) [noise=true , address=45.91.116.8:4047     , piece_id=HPIAADAI3QCOYKI5FM24RU3ZJFPRVA76TADPWJM2YAUKYA5YDZFA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 188.166.225.170:44930->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069231188 (187h23m4.749426757s) [noise=true , address=45.91.116.4:4938     , piece_id=Z36XFJNNWBEFJNCIZBCEH2CCITYHUATVE7R2D6O5ACTAJLEFY53A, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:43848->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069262217 (187h23m4.749457786s) [noise=true , address=77.90.31.18:4807     , piece_id=RXHIPLBLIJS3LT4NNJ7Y2BVLVMKZVTBKXOIL4DGW5P2BX7DV2MIA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: read tcp 188.166.225.170:53260->77.90.31.18:4807: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069372297 (187h23m4.749567867s) [noise=true , address=45.91.116.9:4263     , piece_id=HMAQVI545EY6KNGX7G35TXUZP6BOUJI23ABYU2E25IAAGMVB6MWA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: read tcp 188.166.225.170:59826->45.91.116.9:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069446640 (187h23m4.749642209s) [noise=true , address=45.91.116.6:4975     , piece_id=X7O3X3BRS5FBY6XHUGAAGFONFBAMFF3UW34N7AYS34GCTT5CPWEA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 188.166.225.170:46736->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069466618 (187h23m4.749662188s) [noise=true , address=45.91.116.14:4190    , piece_id=NS4BXRQBBGBYLWQ4QI76R2YG6JQXJUXKR4B2DVVXGWDSHRECWVVA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:39224->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069490154 (187h23m4.749685723s) [noise=true , address=45.91.116.10:4081    , piece_id=F3YZ46LGAIQ32TLZ4PK4DNBUD2RN4HB7HM55HAHYFNQVCXQ4K72Q, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 188.166.225.170:46038->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069525812 (187h23m4.749721381s) [noise=true , address=45.91.116.9:4262     , piece_id=EBXCOBPRTRUR2XDHSWW3AN7HDHQHJPBTB2UNBYQ2A2BNBELLHARA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 188.166.225.170:60260->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069529158 (187h23m4.749724727s) [noise=true , address=45.91.116.6:4973     , piece_id=XJXKZ5DQNPLNFHGLF3VAAS5EIXBR7GACVXRQXXCD4OPQYD76IPBA, seg_pos={0 0}, upload=164904]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:49472->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:31:08.069611025 (187h23m4.749806604s) [seg_pos={0 0}, upload=164904]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 32.345819334s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
6 out of 60 is failed (threshold=3) [.................................................XXXXXX.....]
duration:
30.001395436s
FAIL (2025-09-06 09:31:09 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:27:43.779278335 (187h19m40.459473905s) [upload=164866]: Starting upload
Sep  6 09:27:43.779338612 (187h19m40.459534181s) [upload=164866]: Done starting upload
Sep  6 09:27:43.779387464 (187h19m40.459583033s) [upload=164866]: Uploading segments...
Sep  6 09:27:43.779420899 (187h19m40.459616468s) [upload=164866]: Got next segment. Inline: true
Sep  6 09:27:43.779424937 (187h19m40.459620506s) [upload=164866]: Waiting for error group managing segments...
Sep  6 09:27:43.779457409 (187h19m40.459652978s) [upload=164866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:27:43.779462638 (187h19m40.459658207s) [upload=164866]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:27:43.779465854 (187h19m40.459661413s) [upload=164866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:27:53.418897371 (187h19m50.09909294s) [upload=164866]: Done uploading segments...
Sep  6 09:27:53.418915256 (187h19m50.099110825s) [upload=164866]: Upload finished. err: <nil>
Duration: 30.001408892s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
2 out of 60 is failed (threshold=3) [........................................................X..X]
duration:
2m0.001136568s
FAIL (2025-09-06 09:31:03 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2m0.001183147s edge authservice http us-select-1