Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
681.932283ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:15:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 681.984554ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.499055833s
FAIL (2025-09-05 18:15:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.499084889s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.120748428s
FAIL (2025-09-05 18:15:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.120779538s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.711171605s
FAIL (2025-09-05 18:14:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.711195331s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
730.93179ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:14:51 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 730.959583ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
20.094037691s
FAIL (2025-09-05 18:14:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.094058611s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
7.141589347s
FAIL (2025-09-05 18:14:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 7.141622962s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
734.64623ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:13:54 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 734.711265ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
774.048938ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:13:31 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 774.081811ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.394964862s
FAIL (2025-09-05 18:13:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.394991574s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.557963307s
FAIL (2025-09-05 18:13:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.557993947s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
6.455199947s
FAIL (2025-09-05 18:12:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.455244483s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
736.420031ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:12:25 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 736.440953ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.6053589s
FAIL (2025-09-05 18:12:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.605385221s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
6.127073506s
FAIL (2025-09-05 18:11:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.127097151s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.52530843s
FAIL (2025-09-05 18:11:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.525330253s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
729.043729ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:11:32 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 729.073366ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
767.071878ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:11:03 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 767.097297ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
6.065928066s
FAIL (2025-09-05 18:10:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.0659561s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.532475679s
FAIL (2025-09-05 18:10:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.532499515s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
752.710518ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:10:04 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 752.757487ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
6.285107234s
FAIL (2025-09-05 18:09:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.28514183s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.462846238s
FAIL (2025-09-05 18:09:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.462861446s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.253570222s
FAIL (2025-09-05 18:09:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.253597945s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
700.049858ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:08:53 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 700.07702ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
6.067021422s
FAIL (2025-09-05 18:08:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.06704657s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
685.130717ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:08:31 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 685.176255ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.703820156s
FAIL (2025-09-05 18:08:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.703835876s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.172891987s
FAIL (2025-09-05 18:08:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.172925279s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
739.772952ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:07:25 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 739.799743ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.771389629s
FAIL (2025-09-05 18:07:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.771415558s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.299075955s
FAIL (2025-09-05 18:06:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.299099039s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
717.592997ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:06:52 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 717.617845ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.735806124s
FAIL (2025-09-05 18:06:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.735827105s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
755.722159ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:06:01 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 755.745884ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.099719156s
FAIL (2025-09-05 18:05:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.099749935s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.836694039s
FAIL (2025-09-05 18:05:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.836718226s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.754497864s
FAIL (2025-09-05 18:05:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.754518402s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
7.275301122s
FAIL (2025-09-05 18:05:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 7.275328245s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
720.473809ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:05:14 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 720.50002ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
741.487952ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:04:38 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 741.502059ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.897569874s remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login
FAIL (2025-09-05 18:04:37 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 1m0.897593029s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
21.297570926s
FAIL (2025-09-05 18:04:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 21.297585654s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.718406249s
FAIL (2025-09-05 18:04:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.718419865s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.000768374s
FAIL (2025-09-05 18:04:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000790405s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.367750513s
FAIL (2025-09-05 18:04:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
true , address=45.91.116.4:4937 , piece_id=TJOE7YCIDZJQFQGQCXP7T3GZFMV7MB6PXNKCJBU2CFNQHRW27R5Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55070->45.91.116.4:4937: use of closed network connection
Sep 5 18:04:13.838254666 (171h56m10.518450235s) [noise=true , address=77.90.31.17:4772 , piece_id=3CEPV3LDAUTDE5RJ23XOWLJ6K5OBRRLVYEJ7DQ23OLJU5GHKQSOQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60554->77.90.31.17:4772: use of closed network connection
Sep 5 18:04:13.838271939 (171h56m10.518467498s) [noise=true , address=45.91.116.4:4940 , piece_id=ISRSGX4FH3QUFZRQHNDN52X3RN7PU7FOQE5W5QKPXE3YP5J74QHQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46856->45.91.116.4:4940: use of closed network connection
Sep 5 18:04:13.838312086 (171h56m10.518507655s) [noise=true , address=77.90.31.17:4770 , piece_id=POKDJZDUJYLVRH2QFBABOUJVVOJOWICKVKHYPIRB4PTRZZB5ICCQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->77.90.31.17:4770: use of closed network connection
Sep 5 18:04:13.838354968 (171h56m10.518550537s) [noise=true , address=77.90.31.14:4663 , piece_id=MEJKETH3374J4QZKOENFEHLE5HNOYQMSPG2D6WBW6UBXKW7LWPWQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37708->77.90.31.14:4663: use of closed network connection
Sep 5 18:04:13.838372180 (171h56m10.518567749s) [noise=true , address=45.91.116.10:4082 , piece_id=VMFTIDCOBD2EVZYFTPYOYFXRC4ARRSQKHPEEVIDS2ZJYRJF2HF6Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54880->45.91.116.10:4082: use of closed network connection
Sep 5 18:04:13.838402428 (171h56m10.518597997s) [noise=true , address=45.91.116.9:4261 , piece_id=PYGRE74UNKJLK6KCA26U7F4CMIHY4SS7NGENBUGJMTUF5KNZ76TQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53190->45.91.116.9:4261: use of closed network connection
Sep 5 18:04:13.838418549 (171h56m10.518614118s) [noise=true , address=45.91.116.7:4010 , piece_id=UXQLOKBEOLZVZFYOMKY6FQ2ZCLBCTRO4JDQVWV2LMUKRIJGDTKEA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37048->45.91.116.7:4010: use of closed network connection
Sep 5 18:04:13.838442385 (171h56m10.518637954s) [noise=true , address=77.90.31.10:4518 , piece_id=HCIJVEG6WA37OHL2C6GRWGKMXLKV36KGRDRROOO3DFXCXW6K6NKQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34242->77.90.31.10:4518: use of closed network connection
Sep 5 18:04:13.838462122 (171h56m10.518657691s) [noise=true , address=45.91.116.13:4155 , piece_id=R2CQG6KQID445DEDGOLKEXYTKOYTIS4AQ7ROSVSGVEZ746OIMV2Q, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53874->45.91.116.13:4155: use of closed network connection
Sep 5 18:04:13.838484175 (171h56m10.518679744s) [noise=true , address=77.90.31.15:4697 , piece_id=FYWRB6UW6D4IG4IIMATCTRXHLBHNWSJCJBHHHOWBKSSFP3PLY5CA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44564->77.90.31.15:4697: use of closed network connection
Sep 5 18:04:13.838530383 (171h56m10.518725952s) [noise=true , address=45.91.116.10:4081 , piece_id=46SGY4OZSBDWYNLAW25AI2BKGBSE5XBWPEYN7KBF4ABRLKGHCUSA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->45.91.116.10:4081: use of closed network connection
Sep 5 18:04:13.838568606 (171h56m10.518764175s) [noise=true , address=45.91.116.14:4190 , piece_id=QSMP52GV67Q7GN4M2WQRD27CWH43KPFYUGJBLBZKZVPCCOXS4LQQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->45.91.116.14:4190: use of closed network connection
Sep 5 18:04:13.838574558 (171h56m10.518770127s) [noise=true , address=77.90.31.18:4805 , piece_id=64IBCE7K4R3KZPVD2RRXF76F3LUUZQEIGDWTIRB5PWHFK7FXPESA, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36254->77.90.31.18:4805: use of closed network connection
Sep 5 18:04:13.838587863 (171h56m10.518783432s) [noise=true , address=77.90.31.11:4553 , piece_id=6UHAZJFG3AZTGFH35QNP5HAUNPXF46U4OBEUJXUBNWM5J3Z5UF3A, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53928->77.90.31.11:4553: use of closed network connection
Sep 5 18:04:13.838604365 (171h56m10.518799934s) [noise=true , address=77.90.31.21:4879 , piece_id=4CVXSFLMYISVOWCYNVJGWY2YKTX3LO2NLXPEHTMBJJLTQAHKS4SQ, seg_pos={0 0}, upload=151301]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51078->77.90.31.21:4879: use of closed network connection
Sep 5 18:04:13.838630666 (171h56m10.518826235s) [seg_pos={0 0}, upload=151301]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 30.367771422s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
526.077266ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-05 16:04:04 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 526.104026ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
472.106671ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-05 16:03:06 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 472.142809ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.462119041s
FAIL (2025-09-05 16:02:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.462142396s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
456.377922ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-05 16:02:03 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 456.405255ms
edge
linksharing
us-select-1
|