Orbiter History

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 381.038488ms remote: "tcp:13.233.175.166:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Cf-Cache-Status=HIT Age=263428 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Vary=Accept-Encoding Cf-Ray=976ec35a1e8e41c7-BOM Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 20:22:53 GMT Surrogate-Control=max-age=2147483647 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=i3MJp19bXcFvn18G2l53aAFXWlwkVM.8NU7MRrby7Z0-1756498973834-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/ FAIL (2025-08-29 20:22:53 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 381.050651ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.691271858s FAIL (2025-08-29 20:22:44 UTC) orbiter warning: context deadline exceeded Duration: 6.691289872s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 7.383267325s FAIL (2025-08-29 20:22:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.38329603s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 857.706795ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 20:22:16 GMT Content-Length=166 Cf-Ray=976ec2701dabc03d-BOM Cache-Control=private Set-Cookie=_cfuvid=IXGU_Tsib8QoSo1FaP4UC7ADgZNKLOZ8hjydadX1lg8-1756498936932-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Vary=Accept-Encoding target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:22:16 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 857.750699ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.57092937s FAIL (2025-08-29 20:22:16 UTC) orbiter warning: context deadline exceeded Duration: 6.570954779s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.146821424s FAIL (2025-08-29 20:22:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.146850358s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 672.464568ms remote: "tcp:13.203.125.58:443" response headers: Location=https://static.storj.io/dcs-satellites Cf-Ray=976ec1f95ad6483b-BOM Cache-Control=private Set-Cookie=_cfuvid=KtZS5fNUU1FGJvv_orQDi7qaDsXL_W_CjmpkLAlVv70-1756498917680-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Length=166 Cf-Cache-Status=BYPASS Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 20:21:57 GMT Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:21:57 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 672.48686ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 7.103105789s FAIL (2025-08-29 20:21:50 UTC) orbiter warning: context deadline exceeded Duration: 7.10312732s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 7.347382285s FAIL (2025-08-29 20:21:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.347397975s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 366.661867ms remote: "tcp:13.203.125.58:443" response headers: Set-Cookie=_cfuvid=MlvPtb6o0B2mA2Mw7rpR.boJ3imQYBLH2A9AxSN4R7A-1756498901443-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976ec195bc870029-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 20:21:41 GMT Vary=Accept-Encoding Content-Type=text/html Cf-Cache-Status=HIT Age=263356 Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e target: https://www.storj.io/ FAIL (2025-08-29 20:21:41 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 366.697646ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.128586825s FAIL (2025-08-29 20:21:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.128607734s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 1.622422958s remote: "tcp:3.109.243.18:443" response headers: Content-Type=text/html Content-Length=166 Cf-Cache-Status=BYPASS Vary=Accept-Encoding Set-Cookie=_cfuvid=oXwnu57RNEjz7Pk.NC0VUt7HarnRTS8gu3Bw83NcnIM-1756498856924-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Date=Fri, 29 Aug 2025 20:20:56 GMT Location=https://static.storj.io/dcs-satellites Cf-Ray=976ec079e9ea444b-BOM Cache-Control=private Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:20:56 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 1.622442584s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 7.232641105s FAIL (2025-08-29 20:20:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.232668958s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 575.62304ms remote: "tcp:3.109.243.18:443" response headers: Age=263617 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=7IlNUPX5zauE14b7o1EGybZ4HODZdJpFOL2hzH2vRU4-1756498853009-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Cache-Status=HIT X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 20:20:53 GMT Content-Type=text/html Cf-Ray=976ec06729db7adf-BOM Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 20:20:53 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 575.636916ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.975887568s FAIL (2025-08-29 20:20:37 UTC) orbiter warning: context deadline exceeded Duration: 6.975912175s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 7.428223037s FAIL (2025-08-29 20:20:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.428250911s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.063260038s FAIL (2025-08-29 20:20:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.063281067s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 8.001286128s FAIL (2025-08-29 20:20:11 UTC) orbiter warning: context deadline exceeded Duration: 8.001309322s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 379.204918ms remote: "tcp:3.109.243.18:443" response headers: Age=263648 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Set-Cookie=_cfuvid=zCx76oqkGiJba1CJTPRFHI.4klqbzqBm6PvrljXawR0-1756498809718-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Date=Fri, 29 Aug 2025 20:20:09 GMT Cf-Ray=976ebf588f1e3c94-BOM Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 target: https://www.storj.io/ FAIL (2025-08-29 20:20:09 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 379.224856ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 7.231562412s FAIL (2025-08-29 20:19:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.231583242s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 1.299042374s remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 20:19:52 GMT Cf-Ray=976ebee5f9acc617-BOM Cache-Control=private Set-Cookie=_cfuvid=TdBxthZX7GNoET8QATmShNm1IW4Ldo6kh4VxGmCitXo-1756498792396-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Vary=Accept-Encoding target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:19:52 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 1.299070179s core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.076318356s FAIL (2025-08-29 20:19:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.076338393s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 360.195295ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 20:19:12 GMT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Content-Type=text/html Cf-Ray=976ebdefdea44473-BOM Vary=Accept-Encoding Set-Cookie=_cfuvid=FyNT6nWLi__TS6leCC7RUj8hkF7QCTq8UBhA.tduj.M-1756498752004-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e X-Cluster-Name=ap-south-1-prod-hosting-red Age=263005 target: https://www.storj.io/ FAIL (2025-08-29 20:19:12 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 360.214793ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 8.398720105s FAIL (2025-08-29 20:19:01 UTC) orbiter warning: context deadline exceeded Duration: 8.398741896s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 7.943946226s FAIL (2025-08-29 20:18:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.943972637s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 610.090319ms remote: "tcp:3.109.243.18:443" response headers: Location=https://static.storj.io/dcs-satellites Cf-Ray=976ebd728caaff6e-BOM Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 20:18:52 GMT Content-Type=text/html Content-Length=166 Cf-Cache-Status=BYPASS Cache-Control=private Set-Cookie=_cfuvid=CzVfD370ru1_uscqb4If4KHzhSHI4JGZj5JHR9P86C0-1756498732280-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:18:52 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 610.121849ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.273660674s FAIL (2025-08-29 20:18:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.273717391s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 359.49816ms remote: "tcp:13.233.175.166:443" response headers: Cf-Ray=976ebca81cd83a47-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Age=263538 Surrogate-Control=max-age=2147483647 Set-Cookie=_cfuvid=h1dXQCagMuvn4OBZuCyT_vBkKOyEjLG.aK9wfcqncTk-1756498699586-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Date=Fri, 29 Aug 2025 20:18:19 GMT X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Cache-Status=HIT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html target: https://www.storj.io/ FAIL (2025-08-29 20:18:19 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 359.510744ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 623.900835ms remote: "tcp:13.233.175.166:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 20:18:09 GMT Content-Type=text/html Content-Length=166 Cache-Control=private Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Location=https://static.storj.io/dcs-satellites Cf-Ray=976ebc665839851c-BOM Cf-Cache-Status=BYPASS Set-Cookie=_cfuvid=8S.Zu4CUr4jJCrs1J0D4d2sUvuh7yEb9aeXRkg5Fz1g-1756498689377-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:18:09 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 623.925913ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 12.384325708s FAIL (2025-08-29 20:18:08 UTC) orbiter warning: context deadline exceeded Duration: 12.384344645s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 8.103547337s FAIL (2025-08-29 20:18:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 8.103586612s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 8.835406452s FAIL (2025-08-29 20:17:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 8.835435517s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.301638066s FAIL (2025-08-29 20:17:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.301658143s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 346.842786ms remote: "tcp:13.233.175.166:443" response headers: X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=OOymXMFrU5KB1xpJv76ycv74NPasI2aNFzxk3ylh94w-1756498656612-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 20:17:36 GMT Cf-Ray=976ebb9bacfa1da9-BOM Cf-Cache-Status=HIT Content-Type=text/html Age=263541 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Vary=Accept-Encoding target: https://www.storj.io/ FAIL (2025-08-29 20:17:36 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 346.864378ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 7.549909109s FAIL (2025-08-29 20:17:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.549938174s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 20.332766485s FAIL (2025-08-29 20:17:20 UTC) orbiter warning: context deadline exceeded Duration: 20.332786393s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 633.983679ms remote: "tcp:3.109.243.18:443" response headers: Date=Fri, 29 Aug 2025 20:17:01 GMT Content-Type=text/html Vary=Accept-Encoding Set-Cookie=_cfuvid=UazUN_7YkaC81_FWcMkdYL0arV8fcdPkuHlhgXMRe7I-1756498621279-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Ray=976ebabcae6859a9-BOM Cf-Cache-Status=BYPASS Cache-Control=private Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:17:01 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 634.008356ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 23.378963107s FAIL (2025-08-29 20:16:48 UTC) orbiter warning: context deadline exceeded Duration: 23.378986854s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.998080604s FAIL (2025-08-29 20:16:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.998106143s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 392.710381ms remote: "tcp:3.109.243.18:443" response headers: Content-Type=text/html Vary=Accept-Encoding Date=Fri, 29 Aug 2025 20:16:42 GMT Cf-Ray=976eba4bc98f3afb-BOM Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Set-Cookie=_cfuvid=KfyB37l8Dm3pyvLsjQbFNdZlPw2mAf7a2gUNLebucUE-1756498602875-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Age=263441 Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 20:16:42 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 392.731882ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 8.166010644s FAIL (2025-08-29 20:16:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 8.166036943s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 619.566463ms remote: "tcp:13.233.175.166:443" response headers: Cf-Cache-Status=BYPASS Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 20:16:29 GMT Content-Type=text/html Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Ray=976eb9f62b1b3ffb-BOM Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=N3qUd8MrJvD43mYqUXIr74rbEZS7iTMqqbdb5F1LWKc-1756498589506-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:16:29 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 619.584277ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 7.957422347s FAIL (2025-08-29 20:16:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.957446311s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 1.193791227s remote: "tcp:3.109.243.18:443" response headers: Vary=Accept-Encoding Set-Cookie=_cfuvid=.XyH8jjL7EEURTUWM6KCEj4HsR1PR5o9XoY.p4Ts63g-1756498570230-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 20:16:10 GMT Location=https://static.storj.io/dcs-satellites Cf-Ray=976eb97a18b63b39-BOM Cache-Control=private Content-Type=text/html Content-Length=166 Cf-Cache-Status=BYPASS target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:16:10 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 1.193804072s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 8.497203405s FAIL (2025-08-29 20:16:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Aug 29 20:12:01.707260465 (6h3m58.387456044s) [upload=5290]: Starting upload Aug 29 20:12:01.707320720 (6h3m58.387516289s) [upload=5290]: Done starting upload Aug 29 20:12:01.707399200 (6h3m58.387594769s) [upload=5290]: Uploading segments... Aug 29 20:12:01.707535170 (6h3m58.387730739s) [upload=5290]: Got next segment. Inline: false Aug 29 20:12:01.707577100 (6h3m58.387772669s) [upload=5290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 20:12:01.707582010 (6h3m58.387777579s) [upload=5290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 20:12:02.189310361 (6h3m58.86950593s) [seg_pos={0 0}, upload=5290]: Begin upload segment... Aug 29 20:12:02.189382639 (6h3m58.869578208s) [seg_pos={0 0}, upload=5290]: Done begin upload segment. Aug 29 20:12:02.189416875 (6h3m58.869612444s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189459296 (6h3m58.869654875s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.189833111 (6h3m58.87002869s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190036089 (6h3m58.870231658s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190215914 (6h3m58.870411493s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190603155 (6h3m58.870798724s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.190968533 (6h3m58.871164103s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191212050 (6h3m58.871407629s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191433193 (6h3m58.871628772s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191678572 (6h3m58.871874141s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.191898763 (6h3m58.872094333s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192367931 (6h3m58.87256351s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.192789939 (6h3m58.872985518s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193123026 (6h3m58.873318595s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193448700 (6h3m58.873644269s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:02.193794100 (6h3m58.873989679s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Uploading piece... Aug 29 20:12:08.774058915 (6h4m5.454254485s) [upload=5290]: Next returned nil segment Aug 29 20:12:08.774075457 (6h4m5.454271026s) [upload=5290]: Waiting for error group managing segments... Aug 29 20:12:10.575682122 (6h4m7.255877691s) [noise=true , address=104.36.82.4:4804 , piece_id=PBK675X5EAHTIL3JOUPRWMAZRAE5YJNLDYOQ4KF6N52QIAWEGEVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:12.124592152 (6h4m8.804787722s) [noise=true , address=104.36.82.7:4909 , piece_id=ZHTIMXQZEZPG73LWNVIPBS2ZS7TIWV4DI6MH547I4NS7DGKHYQVQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:16.452434055 (6h4m13.132629625s) [noise=true , address=104.36.82.8:4971 , piece_id=QFAHJVGY3J2MAQIZIFRXDJEHKYEWDUIEHQRRA2JWBDYSB4NODB5Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:17.138755209 (6h4m13.818950778s) [noise=true , address=45.91.116.14:4190 , piece_id=LYPWVYCLXZIXKC3RRSDIJIAXHZZSBLHFD37KCKZZM3ALEVLSSSPA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:18.199322583 (6h4m14.879518152s) [noise=true , address=104.36.82.12:4151 , piece_id=4XSYDC46B6CRC6VMUTDA2AEYBXKC5X72XT2CQH2PYMC3RVNXIS2A, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:21.945628553 (6h4m18.625824162s) [noise=true , address=77.90.31.21:4879 , piece_id=3JRRW3MKTOBQOOWKT635PQHMMRXM5YXCMSF5DRX56BVMTH3OD22Q, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:22.315000497 (6h4m18.995196066s) [noise=true , address=104.36.82.13:4187 , piece_id=BORNHXCFRT244RAXUPSCNOZ4Q6V6GKEHNU2CYSQNM7Y3PERGOMZA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:23.014350639 (6h4m19.694546208s) [noise=true , address=77.90.31.17:4770 , piece_id=HAUXUJCH3DNJ3OQ4JNKCD3URVQS225EGHYDT55G7C5K7SIYW3YWQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:25.207541000 (6h4m21.887736569s) [noise=true , address=104.36.82.11:4114 , piece_id=CFEBRYHSTJ4HMPKWHEVJFWZ2OBDIKDIZ3GHG2N4AMRA3RV3RVFDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:27.385730406 (6h4m24.065925975s) [noise=true , address=104.36.82.10:4078 , piece_id=5FRRCGY7HPI3XDROQKYXLP27T5AA5WYLGZZCKYQC77BGZQ4OL3RQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: <nil> Aug 29 20:12:31.025316605 (6h4m27.705512174s) [noise=true , address=104.36.82.14:4221 , piece_id=HVGUZOWZWM245HGAX3KQR5ZDR7VKJBSAZQTLVVZ4DKAQ4PZN5BMQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026283825 (6h4m27.706479394s) [noise=true , address=45.91.116.10:4083 , piece_id=PN2ZBLTC3K5KTXXEFCA6GURDFF6OQQCJAPUGAP4IIZNKO57SWIDQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026732043 (6h4m27.706927613s) [noise=true , address=77.90.31.19:4843 , piece_id=QLNUJK53QIJCK22UAOSDEIXVBN3ESIIOD5DSIDC437GKA4RXRIHQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 20:12:31.026863404 (6h4m27.707058973s) [noise=true , address=45.91.116.8:4045 , piece_id=SPGGJMUDGTCWYIXYMIPC3ZSI4NFDWK4W44R4VFBQUBY6YZSNANSA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60170->45.91.116.8:4045: use of closed network connection Aug 29 20:12:31.027211190 (6h4m27.707406769s) [noise=true , address=45.91.116.7:4011 , piece_id=E3IJKDQQ6IIS37FNU5IPNKHH6Q7RFEGRQQ4RBPQF6FHGRVVZSTBQ, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36992->45.91.116.7:4011: use of closed network connection Aug 29 20:12:31.027288197 (6h4m27.707483776s) [noise=true , address=104.36.82.5:4838 , piece_id=BGWYDMCKDCKSETW43WDX7FEXC6WSOI7YUWD2OVC4CLWGCN4WXWWA, seg_pos={0 0}, upload=5290]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: read tcp 188.166.225.170:39592->104.36.82.5:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 20:12:31.027310430 (6h4m27.707506009s) [seg_pos={0 0}, upload=5290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Aug 29 20:12:31.267654069 (6h4m27.947849638s) [upload=5290]: Done uploading segments... Aug 29 20:12:31.267784609 (6h4m27.947980188s) [upload=5290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 8.497225398s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 20.350717902s FAIL (2025-08-29 20:16:04 UTC) orbiter warning: context deadline exceeded Duration: 20.35073811s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.448929942s FAIL (2025-08-29 20:15:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.448948789s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 356.259956ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 20:15:42 GMT Content-Type=text/html Cf-Ray=976eb8d22f643bfe-BOM Cf-Cache-Status=HIT Alt-Svc=h3=":443"; ma=86400 Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Age=263381 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Set-Cookie=_cfuvid=9qx8EsByjxRoizRQ4IJ36ziDBlNnIJpjPc97K0MLjn0-1756498542460-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Surrogate-Control=max-age=2147483647 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e target: https://www.storj.io/ FAIL (2025-08-29 20:15:42 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 356.297067ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 14.821601482s FAIL (2025-08-29 20:15:40 UTC) orbiter warning: context deadline exceeded Duration: 14.821642391s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 1.010851144s remote: "tcp:13.203.125.58:443" response headers: Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Content-Length=166 Cf-Ray=976eb8b3ca8f837d-BOM Vary=Accept-Encoding Date=Fri, 29 Aug 2025 20:15:37 GMT Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private Set-Cookie=_cfuvid=H2nqx.gqBeQdA4UGI7cHI3PVZARoQ3_BsZkMDQ60oIw-1756498537960-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 20:15:38 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 1.010889667s core website

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)