Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
741.401555ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:22:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 741.423247ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.77112632s
FAIL (2025-07-16 17:21:50 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.771145518s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
817.921886ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:21:11 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 817.937455ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.895965553s
FAIL (2025-07-16 17:20:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.895992104s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
649.816602ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:20:11 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 649.847371ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.141728258s target:
https://us1.storj.io/login
FAIL (2025-07-16 17:19:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 1.141762352s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.810829241s
FAIL (2025-07-16 17:19:45 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.810856852s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
649.309904ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:19:13 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 649.333188ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.858002642s
FAIL (2025-07-16 17:19:02 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.858055484s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.109383463s target:
https://us1.storj.io/login
FAIL (2025-07-16 17:17:59 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 1.109409634s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.889180894s
FAIL (2025-07-16 17:17:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.88920459s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
642.819556ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:17:36 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 642.844463ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
653.351847ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:17:04 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 653.392565ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.818797414s
FAIL (2025-07-16 17:17:03 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.818825016s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.754681382s
FAIL (2025-07-16 17:16:48 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.754721068s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.846600723s
FAIL (2025-07-16 17:16:02 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.846629138s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.636679922s target:
https://us1.storj.io/login
FAIL (2025-07-16 17:16:02 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 1.636709308s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.967726299s
FAIL (2025-07-16 17:15:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 5.967754373s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.114406355s target:
https://us1.storj.io/login
FAIL (2025-07-16 17:14:55 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 1.114438507s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
15.920388588s
FAIL (2025-07-16 17:14:24 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 15.920407764s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
674.586667ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:14:07 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 674.613618ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.239245191s
FAIL (2025-07-16 17:14:04 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
8s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.353622656 (560h3m10.124263991s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354294861 (560h3m10.124936186s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354363453 (560h3m10.125004788s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.354678746 (560h3m10.125320081s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355069433 (560h3m10.125710758s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355338278 (560h3m10.125979613s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355883772 (560h3m10.126525107s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.355948004 (560h3m10.126589339s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356291532 (560h3m10.126932857s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356673974 (560h3m10.127315319s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356786419 (560h3m10.127427754s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356940995 (560h3m10.12758233s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.356990359 (560h3m10.127631694s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.357344416 (560h3m10.127985741s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:35.359051944 (560h3m10.129693269s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Uploading piece...
Jul 16 17:13:37.019475830 (560h3m11.790117165s) [upload=447856]: Next returned nil segment
Jul 16 17:13:37.019497291 (560h3m11.790138626s) [upload=447856]: Waiting for error group managing segments...
Jul 16 17:13:37.415799995 (560h3m12.18644133s) [noise=true , address=45.91.116.5:4297 , piece_id=Q7JHEU5WTFID2TVTV3AI3U7SKBNNF7FG6FVIOATVZQEPY3A54YIA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.426121553 (560h3m12.196762888s) [noise=true , address=45.91.116.9:4262 , piece_id=O6UWYZWCKTHSNJZHKUVCX3SEUSZ2GHRX6SOQTQM2GWGPAIQTMC7Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.435995165 (560h3m12.2066365s) [noise=true , address=45.91.116.12:4225 , piece_id=F73QGQF4YLSMYULZXDJ5LZKIKE2NTONDQGGMRPSMLQVQR75CHZBQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.483005983 (560h3m12.253647318s) [noise=true , address=104.36.82.16:4293 , piece_id=LYO7KSVV7G53S5JCJMO67XHUJJVTY2KKAYRJBJSUQZOTHI6NBBWQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.487870681 (560h3m12.258512006s) [noise=true , address=45.91.116.11:4118 , piece_id=V6OGZW6YBJYSSUNRJNT2O5WICU7XSZ5EXAQKXPESHTJWDW4LTR2A, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.494653719 (560h3m12.265295044s) [noise=true , address=45.91.116.14:4190 , piece_id=MZ3HO5UXPTCLOEYKA3ZRJU75TETMYEJQ4AD4SNCPMJQBDTRQHQ5Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.496306230 (560h3m12.266947556s) [noise=true , address=45.91.116.5:4298 , piece_id=VGWXQIZCYPGJESM4K4XBCZ7HTZ2KSRUQ7EPGLAI5E4CVY4FIJAVA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.582358589 (560h3m12.352999924s) [noise=true , address=45.91.116.10:4083 , piece_id=HLUTN74JOVCNDTJG747NI3A4SSOPYPSTIFFACFSSMQPZDNVCF7DQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:13:37.652502618 (560h3m12.423143953s) [noise=true , address=45.91.116.6:4973 , piece_id=VZVI3FTYWW3P3YVX2T4QZDKABDB3OHGLWC6KCX6HGJXNLHVQHUYA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: <nil>
Jul 16 17:14:04.467099894 (560h3m39.237741229s) [noise=true , address=77.90.31.11:4553 , piece_id=CPCKFTQPE326Z7ZEL75FLRXMNTMILJAN5XGCYY6Q2QBHQFBVQZFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53784->77.90.31.11:4553: use of closed network connection
Jul 16 17:14:04.467314154 (560h3m39.237955509s) [noise=true , address=77.90.31.17:4771 , piece_id=I355ZK62AFKHZ2PWDAFWGQQMAOFRS2AHBM5P2BDROB27MMEALDYQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:33690->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 16 17:14:04.467417502 (560h3m39.238058837s) [noise=true , address=77.90.31.15:4698 , piece_id=G5LE74PJX6G7VMOXW5EHC6MEB7QJ2T3ONUPPYYUTZIIPNSPHRNGA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43878->77.90.31.15:4698: use of closed network connection
Jul 16 17:14:04.467453460 (560h3m39.238094825s) [noise=true , address=77.90.31.10:4518 , piece_id=RGUOX6IHO6KX3LSAMF7SRGYOEYOUWN5JYHTMJUEA55LBFMC5YZPQ, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47318->77.90.31.10:4518: use of closed network connection
Jul 16 17:14:04.467653613 (560h3m39.238294948s) [noise=true , address=77.90.31.10:4520 , piece_id=HBWJIVYPUAMCFKOIVRSRM7QPGPRE6C3I7ZNJJZKQMJWT6PLFAI2Q, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42952->77.90.31.10:4520: use of closed network connection
Jul 16 17:14:04.467688811 (560h3m39.238330146s) [noise=true , address=77.90.31.15:4697 , piece_id=RW225FR6UKCSA5ACPCRGKLMDOHYDNJ7YSBOCIVJZY54R4LSLEASA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54854->77.90.31.15:4697: use of closed network connection
Jul 16 17:14:04.467757321 (560h3m39.238398657s) [noise=true , address=77.90.31.19:4843 , piece_id=HBHXC2PA6375TLOR3YFH7YOFIMWNXTOTQUTZGJUDVKVURPMUJDFA, seg_pos={0 0}, upload=447856]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->77.90.31.19:4843: use of closed network connection
Jul 16 17:14:04.467801767 (560h3m39.238443102s) [seg_pos={0 0}, upload=447856]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Jul 16 17:14:04.704342881 (560h3m39.474984216s) [upload=447856]: Done uploading segments...
Jul 16 17:14:04.704368470 (560h3m39.475009795s) [upload=447856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 30.23926559s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
656.124532ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:12:58 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 656.145042ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.046519442s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:11:55 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.046547546s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
647.699482ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:11:55 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 647.729379ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.079662266s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:11:31 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.07969608s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
646.552258ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:10:49 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 646.604256ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.028754031s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:10:25 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.02877909s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.234066386s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:10:09 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.234086426s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
650.312784ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:09:40 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 650.381385ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.035006975s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:09:25 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.035033267s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.075637195s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:08:57 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.07565618s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
817.131032ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:08:54 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 817.152315ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.02209103s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:08:11 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.022139744s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
704.815915ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:07:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 704.848547ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.239576937s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:07:18 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.239600583s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
642.348636ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:07:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 642.367021ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.420128948s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:06:39 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.420149747s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
638.231137ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:06:31 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 638.255132ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.145505578s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:05:48 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.145533682s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
660.516836ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:05:34 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 660.54ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.096712799s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:05:13 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.096735953s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
8.085853324s target:
https://us1.storj.io/login
FAIL (2025-07-16 17:04:48 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 8.085878082s
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.032692496s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:04:39 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.03271547s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.05135288s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:03:59 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.051370104s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
215.911293ms target:
https://us1.storj.io/login
FAIL (2025-07-16 17:03:44 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 215.945368ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.021882153s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:03:31 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.021898364s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.015061202s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:02:27 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.015082523s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.084446296s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:01:16 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.084467946s
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.027773629s remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Wed, 16 Jul 2025 16:28:03 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-16 17:00:08 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.027796563s
edge
ipfs
us1
|