Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [........XXXXX...............................................] duration: 5.968972067s FAIL (2025-08-29 09:53:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.969006623s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 653.811462ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 09:53:46 GMT Content-Type=text/html Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS X-Cluster-Name=ap-south-1-prod-hosting-red Content-Length=166 Cf-Ray=976b29c63d913a59-BOM Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=g2pXu.2iW0upejqHxhimMU4fHIjmzkUpL9RfSMJW5gw-1756461226353-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:53:46 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 653.831002ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 374.757704ms remote: "tcp:13.233.175.166:443" response headers: Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Set-Cookie=_cfuvid=cPpizepC60.obvn9Ra.Qtck1x1jwsjZ9ES9Ahxi0DgI-1756461218485-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Cache-Status=HIT Date=Fri, 29 Aug 2025 09:53:38 GMT Content-Type=text/html Cf-Ray=976b29972b680ac9-BOM Surrogate-Control=max-age=2147483647 Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Age=225982 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 09:53:38 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 374.784494ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 5.887616861s FAIL (2025-08-29 09:53:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.887648533s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........XXXXX..............................................] duration: 5.996997937s FAIL (2025-08-29 09:53:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.997026802s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 646.663924ms remote: "tcp:13.233.175.166:443" response headers: Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT Age=225451 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Set-Cookie=_cfuvid=tyPlV8KrMCt2jM8wgNh7UdL.R45ZQKj7VC0ILcqHFkY-1756461198191-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Date=Fri, 29 Aug 2025 09:53:18 GMT Cf-Ray=976b29182b1a80b2-BOM Surrogate-Control=max-age=2147483647 Vary=Accept-Encoding target: https://www.storj.io/ FAIL (2025-08-29 09:53:18 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 646.685836ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.031106984s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:53:14 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.031133624s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 5.965638371s FAIL (2025-08-29 09:53:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.965671696s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........XXXXX.............................................] duration: 5.878353072s FAIL (2025-08-29 09:53:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.878398869s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 334.275271ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:52:56 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 334.314106ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........XXXXX............................................] duration: 5.917478704s FAIL (2025-08-29 09:52:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.917501948s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 5.593266945s FAIL (2025-08-29 09:52:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.593287945s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 381.858815ms remote: "tcp:13.203.125.58:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:52:38 GMT Content-Type=text/html Vary=Accept-Encoding Set-Cookie=_cfuvid=wsGxIQ0QN2CsRpkwzHjhqJt9gw9QRE8J_IKumWIReKg-1756461158253-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Cache-Status=HIT Age=225997 Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Cf-Ray=976b281eaa113a45-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 09:52:38 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 381.880437ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 625.418836ms remote: "tcp:3.109.243.18:443" response headers: Date=Fri, 29 Aug 2025 09:52:34 GMT Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private Content-Type=text/html Content-Length=166 Cf-Ray=976b28080b7c4457-BOM Vary=Accept-Encoding Set-Cookie=_cfuvid=P.zZRvXuhtddab5zUSMGNiytzF.TyNYMOAyE_REVqPA-1756461154930-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:52:34 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 625.441409ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [............XXXXX...........................................] duration: 5.832485793s FAIL (2025-08-29 09:52:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.832514788s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 6.007864352s FAIL (2025-08-29 09:52:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.007891453s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 5.913802826s FAIL (2025-08-29 09:51:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.91382566s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 416.005976ms remote: "tcp:13.233.175.166:443" response headers: Age=225562 Surrogate-Control=max-age=2147483647 Date=Fri, 29 Aug 2025 09:51:47 GMT Cf-Ray=976b26e0dd1d3e04-BOM Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 Vary=Accept-Encoding Set-Cookie=_cfuvid=XIT9XugGIAfLfr01MuSW1hsdIl20TxMD_UWnF9XD3es-1756461107431-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/ FAIL (2025-08-29 09:51:47 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 416.027676ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 638.67199ms remote: "tcp:13.233.175.166:443" response headers: Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=Gtzu0mKtix3W5rBpT58tSGACErf7DxZQsn05fUmvJ8Y-1756461106992-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Content-Length=166 Cf-Cache-Status=BYPASS X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:51:47 GMT Content-Type=text/html Location=https://static.storj.io/dcs-satellites Cf-Ray=976b26dc5d253f05-BOM target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:51:47 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 638.695794ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 302.905095ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:51:44 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 302.924302ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 5.554136846s FAIL (2025-08-29 09:51:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.554163857s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............XXXXX..........................................] duration: 5.848240343s FAIL (2025-08-29 09:51:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.848269379s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 5.656524742s FAIL (2025-08-29 09:51:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.656552295s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.060674591s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:51:20 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.060703055s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 5.849090903s FAIL (2025-08-29 09:51:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.849108927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 390.371006ms remote: "tcp:3.109.243.18:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 09:50:52 GMT Content-Type=text/html Cf-Ray=976b258b9f063a2c-BOM Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding Set-Cookie=_cfuvid=zFyA7lw0V1NBUVjfqbw2YJ2UvFE8UGzsaH_n05t5ICk-1756461052809-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Age=225891 target: https://www.storj.io/ FAIL (2025-08-29 09:50:52 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 390.390793ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 629.733232ms remote: "tcp:13.233.175.166:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Cf-Ray=976b252d993b4418-BOM Cache-Control=private Date=Fri, 29 Aug 2025 09:50:38 GMT Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Vary=Accept-Encoding Set-Cookie=_cfuvid=4eH33JoX0aT9AmMMMUf91WHYow_piuSoYZWvr2z569s-1756461038066-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:50:38 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 629.754183ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 617.539887ms remote: "tcp:13.233.175.166:443" response headers: Content-Type=text/html Cf-Cache-Status=HIT Surrogate-Control=max-age=2147483647 Set-Cookie=_cfuvid=CTfDmFrgrTTBaj1hbkPfen2ILwOXOko3wfJ2jG74Q_g-1756461026058-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:50:26 GMT Cf-Ray=976b24e47bc646ec-BOM X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Age=225279 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 target: https://www.storj.io/ FAIL (2025-08-29 09:50:26 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 617.56739ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............XXXXX.........................................] duration: 6.077705932s FAIL (2025-08-29 09:50:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.077738134s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 638.659225ms remote: "tcp:13.233.175.166:443" response headers: Cf-Ray=976b24aebe830e6e-BOM Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 09:50:17 GMT Content-Type=text/html Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=tEdBZtuIMyy7TqoLipmXEY199yeGJscBZCyLAUJeeXw-1756461017767-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Length=166 Location=https://static.storj.io/dcs-satellites target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:50:17 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 638.683059ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................XX...................................] duration: 5.986377549s FAIL (2025-08-29 09:50:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.986434047s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 5.695058948s FAIL (2025-08-29 09:50:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.695088946s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 957.568657ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:50:12 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 957.601371ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............XXXXX........................................] duration: 5.793940352s FAIL (2025-08-29 09:49:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.793973006s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................XX..................................] duration: 5.617652621s FAIL (2025-08-29 09:49:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.617700662s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [................XXXXX.......................................] duration: 5.914857446s FAIL (2025-08-29 09:49:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.914888895s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 617.536131ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 09:49:30 GMT Content-Type=text/html Content-Length=166 Cf-Ray=976b2384c966ff70-BOM Cf-Cache-Status=BYPASS Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Location=https://static.storj.io/dcs-satellites Cache-Control=private Set-Cookie=_cfuvid=CaLgvyqM6CbFXFenQPMEwSy97kQgMvbN3RPVaJE8nOI-1756460970083-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:49:30 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 617.558162ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 5.989577072s FAIL (2025-08-29 09:49:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.989603221s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 398.794365ms remote: "tcp:13.203.125.58:443" response headers: Age=225213 Surrogate-Control=max-age=2147483647 Date=Fri, 29 Aug 2025 09:49:20 GMT Cf-Cache-Status=HIT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976b234bf94147b5-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Set-Cookie=_cfuvid=HBD86O23ml03Sp7olP9uTZ3LHbU0dqd_nm_mtKvHVVA-1756460960699-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/ FAIL (2025-08-29 09:49:20 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 398.813242ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.036280146s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:49:20 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.036303751s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................XX.................................] duration: 5.66402585s FAIL (2025-08-29 09:49:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.664057279s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................XXXXX......................................] duration: 5.887215322s FAIL (2025-08-29 09:48:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.887249717s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.84661885s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:48:48 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.846650512s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 5.711351441s FAIL (2025-08-29 09:48:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.711384953s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..................XXXXX.....................................] duration: 5.890696627s FAIL (2025-08-29 09:48:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.890723539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 5.874189586s FAIL (2025-08-29 09:48:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.874236567s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 655.636116ms remote: "tcp:13.233.175.166:443" response headers: Date=Fri, 29 Aug 2025 09:48:19 GMT Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Vary=Accept-Encoding Set-Cookie=_cfuvid=8wJbc6dQ5qhD0x3h.vUESN6FoUzQ97rv1rZZPOVt0MQ-1756460899616-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Cf-Ray=976b21cc1aa33e39-BOM Cache-Control=private Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:48:19 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 655.672265ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 398.851275ms remote: "tcp:13.233.175.166:443" response headers: Content-Type=text/html Vary=Accept-Encoding Date=Fri, 29 Aug 2025 09:48:07 GMT Age=225726 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=GMViI.pyPVovTseQ7qhUMmAtdGu.tKhMosZ_OJRokp0-1756460887121-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976b21801fff8374-BOM Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 09:48:07 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 398.874789ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 5.825635815s FAIL (2025-08-29 09:47:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.82566459s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...................XXXXX....................................] duration: 5.851328264s FAIL (2025-08-29 09:47:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.851359073s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)