Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 469200 reports (Page 5912 of 9384)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
6.411765989s
FAIL (2025-08-29 20:44:34 UTC)
orbiter warning: context deadline exceeded
Duration: 6.411796477s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
612.516434ms
remote:
"tcp:13.203.125.58:443"
response headers:
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 29 Aug 2025 20:44:30 GMT
Content-Length=166
Location=https://static.storj.io/dcs-satellites
Cf-Cache-Status=BYPASS
Cache-Control=private
Set-Cookie=_cfuvid=FWJx6U4j9XG_sHkwRAhUxrBAm7KeVPFHRYTat70qq1I-1756500270626-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Alt-Svc=h3=":443"; ma=86400
Content-Type=text/html
Cf-Ray=976ee3012f093f60-BOM
Vary=Accept-Encoding
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:44:30 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 612.547714ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.............XX.............................................]
duration:
7.386400967s
FAIL (2025-08-29 20:44:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 7.386425364s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
593.574088ms
remote:
"tcp:13.203.125.58:443"
response headers:
Content-Type=text/html
Surrogate-Control=max-age=2147483647
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Cf-Ray=976ee2fa7e7323ff-BOM
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Set-Cookie=_cfuvid=UuYzJ8M3_LycDtBGXavzBi92Lpfh.m8CEt_jRKDEIEk-1756500269238-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Date=Fri, 29 Aug 2025 20:44:29 GMT
Alt-Svc=h3=":443"; ma=86400
Cf-Cache-Status=HIT
Age=265033
Vary=Accept-Encoding
X-Cluster-Name=ap-south-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-29 20:44:29 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 593.589156ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
6.381024749s
FAIL (2025-08-29 20:44:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.381048625s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
373.468434ms
remote:
"tcp:13.233.175.166:443"
response headers:
Set-Cookie=_cfuvid=lLt9Boear4LvI4Z2nBKKlgueK_BgzLbDbh3fFEe6a48-1756500225705-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Content-Type=text/html
Alt-Svc=h3=":443"; ma=86400
Date=Fri, 29 Aug 2025 20:43:45 GMT
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
X-Cluster-Name=ap-south-1-prod-hosting-red
Cf-Ray=976ee1ea5e3831cf-BOM
Cf-Cache-Status=HIT
Age=264450
Surrogate-Control=max-age=2147483647
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Vary=Accept-Encoding
target:
https://www.storj.io/
FAIL (2025-08-29 20:43:45 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 373.490867ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
5.828228885s
FAIL (2025-08-29 20:43:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.828248643s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
694.945403ms
remote:
"tcp:13.203.125.58:443"
response headers:
Cache-Control=private
Set-Cookie=_cfuvid=dEfp9z9jiSFsmLIIKnwAfck7MMOCj2mt7T69DaOMbvo-1756500208906-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 29 Aug 2025 20:43:28 GMT
Content-Length=166
Cf-Cache-Status=BYPASS
Vary=Accept-Encoding
Alt-Svc=h3=":443"; ma=86400
Content-Type=text/html
Location=https://static.storj.io/dcs-satellites
Cf-Ray=976ee17efb394457-BOM
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:43:28 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 694.963869ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
6.872766088s
FAIL (2025-08-29 20:43:28 UTC)
orbiter warning: context deadline exceeded
Duration: 6.872784464s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..............XX............................................]
duration:
6.990595407s
FAIL (2025-08-29 20:43:20 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 6.990625205s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
599.627832ms
remote:
"tcp:13.203.125.58:443"
response headers:
X-Cluster-Name=ap-south-1-prod-hosting-red
Cf-Cache-Status=HIT
Vary=Accept-Encoding
Set-Cookie=_cfuvid=xfk2Fhnva_POCr4WV3YnamU_QEkulTwx9f4KWKgFfmg-1756500198373-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Date=Fri, 29 Aug 2025 20:43:18 GMT
Age=264962
Surrogate-Control=max-age=2147483647
Alt-Svc=h3=":443"; ma=86400
Cf-Ray=976ee13f887eb13b-BOM
Content-Type=text/html
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
target:
https://www.storj.io/
FAIL (2025-08-29 20:43:18 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 599.649413ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
469.926639ms
remote:
"tcp:13.203.125.58:443"
response headers:
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Set-Cookie=_cfuvid=80UhNG5h.vEcGJsoqamjMS27mjJhkMiq.ygHQl2pOco-1756500166688-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Cf-Cache-Status=HIT
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Surrogate-Control=max-age=2147483647
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
Content-Type=text/html
Vary=Accept-Encoding
Date=Fri, 29 Aug 2025 20:42:46 GMT
Cf-Ray=976ee078ee0147f6-BOM
Age=264419
target:
https://www.storj.io/
FAIL (2025-08-29 20:42:46 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 469.942699ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
6.698137238s
FAIL (2025-08-29 20:42:44 UTC)
orbiter warning: context deadline exceeded
Duration: 6.698161012s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
6.05792626s
FAIL (2025-08-29 20:42:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.057940828s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...............XX...........................................]
duration:
7.369238969s
FAIL (2025-08-29 20:42:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 7.369263929s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
604.765262ms
remote:
"tcp:3.109.243.18:443"
response headers:
Set-Cookie=_cfuvid=NzMpSmCrkftFLGbYSkoIrCmZBkSlNdu1sRNC19Cgaf8-1756500134348-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Content-Type=text/html
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 29 Aug 2025 20:42:14 GMT
Content-Length=166
Location=https://static.storj.io/dcs-satellites
Cf-Ray=976edfad8f82ff70-BOM
Cf-Cache-Status=BYPASS
Cache-Control=private
Vary=Accept-Encoding
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:42:14 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 604.788286ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
6.287249134s
FAIL (2025-08-29 20:42:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.287274033s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................]
duration:
7.983175262s
FAIL (2025-08-29 20:42:02 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 7.983199791s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
718.113837ms
remote:
"tcp:13.233.175.166:443"
response headers:
Content-Length=166
Cache-Control=private
Vary=Accept-Encoding
Set-Cookie=_cfuvid=vGVBsM6HsOYtAnvCQqjf9_N7WHFyzFnbMRXHw2aj7vo-1756500118352-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 29 Aug 2025 20:41:58 GMT
Content-Type=text/html
Location=https://static.storj.io/dcs-satellites
Cf-Ray=976edf48daecff6c-BOM
Cf-Cache-Status=BYPASS
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:41:58 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 718.134476ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
714.687831ms
remote:
"tcp:13.233.175.166:443"
response headers:
Date=Fri, 29 Aug 2025 20:41:53 GMT
Content-Type=text/html
Age=264952
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
X-Cluster-Name=ap-south-1-prod-hosting-red
Surrogate-Control=max-age=2147483647
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Vary=Accept-Encoding
Alt-Svc=h3=":443"; ma=86400
Cf-Ray=976edf2f985b3b0f-BOM
Cf-Cache-Status=HIT
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Set-Cookie=_cfuvid=ZOYIv5daQFmkxMOOmQIYF8pWUlbFLeszdcnbI24KGJ8-1756500113914-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
target:
https://www.storj.io/
FAIL (2025-08-29 20:41:54 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 714.708791ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
6.601941176s
FAIL (2025-08-29 20:41:54 UTC)
orbiter warning: context deadline exceeded
Duration: 6.601963578s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
6.207074598s
FAIL (2025-08-29 20:41:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.207096039s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.................XX.........................................]
duration:
7.374899094s
FAIL (2025-08-29 20:41:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 7.374917078s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
6.106722294s
FAIL (2025-08-29 20:41:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.106762571s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
6.609662892s
FAIL (2025-08-29 20:41:17 UTC)
orbiter warning: context deadline exceeded
Duration: 6.609695244s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
631.840568ms
remote:
"tcp:13.233.175.166:443"
response headers:
Cf-Cache-Status=BYPASS
Cache-Control=private
Vary=Accept-Encoding
Set-Cookie=_cfuvid=vd0045EX.9o9JKzIwpL3TeDn4xAMWAELgUH.PkCIu_M-1756500064405-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Alt-Svc=h3=":443"; ma=86400
Date=Fri, 29 Aug 2025 20:41:04 GMT
Content-Length=166
Location=https://static.storj.io/dcs-satellites
X-Cluster-Name=ap-south-1-prod-hosting-red
Content-Type=text/html
Cf-Ray=976eddf83b923a14-BOM
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:41:04 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 631.864634ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
6.653664696s
FAIL (2025-08-29 20:41:02 UTC)
orbiter warning: context deadline exceeded
Duration: 6.653689663s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................]
duration:
7.011417356s
FAIL (2025-08-29 20:40:59 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 7.011441202s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
367.097303ms
remote:
"tcp:13.203.125.58:443"
response headers:
Content-Type=text/html
Surrogate-Control=max-age=2147483647
Set-Cookie=_cfuvid=alhi8Z3ozacXIhdpdIYPTDd798erOqmg0YU3v8t7UOk-1756500043374-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 29 Aug 2025 20:40:43 GMT
Cf-Ray=976edd76de273e04-BOM
Cf-Cache-Status=HIT
Age=264498
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Vary=Accept-Encoding
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
target:
https://www.storj.io/
FAIL (2025-08-29 20:40:43 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 367.119134ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
6.226653309s
FAIL (2025-08-29 20:40:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.226677305s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
6.134432071s
FAIL (2025-08-29 20:40:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.134454183s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
2.396118161s
remote:
"tcp:3.109.243.18:443"
response headers:
Content-Type=text/html
Cf-Cache-Status=BYPASS
Cache-Control=private
Vary=Accept-Encoding
Alt-Svc=h3=":443"; ma=86400
Date=Fri, 29 Aug 2025 20:40:08 GMT
Content-Length=166
Location=https://static.storj.io/dcs-satellites
Cf-Ray=976edc8df8ac85d9-BOM
Set-Cookie=_cfuvid=iq0tubYI4QQotgUGssLtO8ANDkSaJKBslWF2Lr47pGU-1756500007989-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
X-Cluster-Name=ap-south-1-prod-hosting-red
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:40:08 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 2.396140423s core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
362.757448ms
remote:
"tcp:3.109.243.18:443"
response headers:
Date=Fri, 29 Aug 2025 20:40:06 GMT
Cf-Cache-Status=HIT
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Content-Type=text/html
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Vary=Accept-Encoding
X-Cluster-Name=ap-south-1-prod-hosting-red
Age=264891
Surrogate-Control=max-age=2147483647
Alt-Svc=h3=":443"; ma=86400
Cf-Ray=976edc90180c64e0-BOM
Set-Cookie=_cfuvid=VZ9YULb5MtAYiuUxnYYFjcE5P7HLoeiEjhk2fjrs8iA-1756500006460-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
target:
https://www.storj.io/
FAIL (2025-08-29 20:40:06 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 362.78376ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................]
duration:
7.906130662s
FAIL (2025-08-29 20:39:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 7.906186107s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
6.605529182s
FAIL (2025-08-29 20:39:50 UTC)
orbiter warning: context deadline exceeded
Duration: 6.605542527s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
394.900202ms
remote:
"tcp:13.203.125.58:443"
response headers:
Date=Fri, 29 Aug 2025 20:39:35 GMT
Set-Cookie=_cfuvid=409oyBxxH2lpx0lDQPoPHGrLRr_Ffrehagx2cDYLxoY-1756499975798-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Content-Type=text/html
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Vary=Accept-Encoding
Cf-Ray=976edbd048eb3a39-BOM
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Alt-Svc=h3=":443"; ma=86400
Cf-Cache-Status=HIT
Age=264814
Surrogate-Control=max-age=2147483647
X-Cluster-Name=ap-south-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-29 20:39:35 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 394.922835ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
938.353468ms
remote:
"tcp:13.203.125.58:443"
response headers:
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 29 Aug 2025 20:39:05 GMT
Cf-Ray=976edb103f28ff7b-BOM
Cache-Control=private
Vary=Accept-Encoding
Set-Cookie=_cfuvid=ZlkKZghd45TioJmvWQBc2E4Jdy5UiCppfNjgBfdYZKk-1756499945449-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Content-Type=text/html
Content-Length=166
Location=https://static.storj.io/dcs-satellites
Cf-Cache-Status=BYPASS
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:39:05 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 938.376873ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
6.198359904s
FAIL (2025-08-29 20:39:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.198381906s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
6.854697797s
FAIL (2025-08-29 20:39:01 UTC)
orbiter warning: context deadline exceeded
Duration: 6.854721702s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....................XX......................................]
duration:
7.365684398s
FAIL (2025-08-29 20:38:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 7.365710016s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
350.304911ms
remote:
"tcp:13.203.125.58:443"
response headers:
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Vary=Accept-Encoding
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 29 Aug 2025 20:38:36 GMT
Age=264680
Surrogate-Control=max-age=2147483647
Content-Type=text/html
Cf-Ray=976eda5b1bfb68a4-BOM
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Set-Cookie=_cfuvid=iJ4vOdN07yuLCJBoqnRET5IM.jucvfQTPS8z0btBDxk-1756499916048-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Cf-Cache-Status=HIT
target:
https://www.storj.io/
FAIL (2025-08-29 20:38:36 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 350.327235ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
6.902170319s
FAIL (2025-08-29 20:38:33 UTC)
orbiter warning: context deadline exceeded
Duration: 6.902187611s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
369.220365ms
remote:
"tcp:13.233.175.166:443"
response headers:
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Surrogate-Control=max-age=2147483647
Vary=Accept-Encoding
Set-Cookie=_cfuvid=yqSNj98TFNCYQmXcjsuXShtBagZxGV8Hygp6O4I5vKg-1756499897301-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Cf-Ray=976ed9e5df61160c-BOM
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Date=Fri, 29 Aug 2025 20:38:17 GMT
Cf-Cache-Status=HIT
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
Age=264661
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-29 20:38:17 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 369.239331ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
5.94204842s
FAIL (2025-08-29 20:38:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.942069149s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
6.629091303s
FAIL (2025-08-29 20:38:07 UTC)
orbiter warning: context deadline exceeded
Duration: 6.629110329s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
670.308092ms
remote:
"tcp:13.233.175.166:443"
response headers:
Date=Fri, 29 Aug 2025 20:37:50 GMT
Content-Type=text/html
Content-Length=166
Location=https://static.storj.io/dcs-satellites
Cf-Ray=976ed93efac080b6-BOM
Cache-Control=private
Vary=Accept-Encoding
Cf-Cache-Status=BYPASS
Set-Cookie=_cfuvid=7iBGcauVEs6c6FGR7V2WfzCyFQ9Hf3zHXOgDu8EOzB8-1756499870953-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Alt-Svc=h3=":443"; ma=86400
X-Cluster-Name=ap-south-1-prod-hosting-red
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-29 20:37:51 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 670.33261ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.....................XX.....................................]
duration:
8.047797663s
FAIL (2025-08-29 20:37:49 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload
Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload
Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments...
Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false
Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment...
Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment.
Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece...
Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment
Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments...
Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804     , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909     , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971     , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190    , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151    , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879     , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187    , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770     , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114    , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078    , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil>
Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221    , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083    , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843     , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF
Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045     , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection
Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011     , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection
Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838     , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments...
Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 8.047817962s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
5.575653373s
FAIL (2025-08-29 20:37:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.575669332s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX]
duration:
357.255522ms
remote:
"tcp:13.233.175.166:443"
response headers:
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Date=Fri, 29 Aug 2025 20:37:23 GMT
Cf-Ray=976ed892f9a24019-BOM
Age=264298
Surrogate-Control=max-age=2147483647
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
Vary=Accept-Encoding
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
Set-Cookie=_cfuvid=o4oyKfoP9CsHzcHag9CEdj8WtK6AAbFeV6pkqVjuCKg-1756499843061-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Alt-Svc=h3=":443"; ma=86400
Content-Type=text/html
Cf-Cache-Status=HIT
X-Cluster-Name=ap-south-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-29 20:37:23 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 357.270049ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
6.04253718s
FAIL (2025-08-29 20:37:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.042563932s edge gateway us-select-1