Orbiter History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 333.953744ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:59:50 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 334.01984ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 5.885244552s FAIL (2025-08-29 09:59:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.885279328s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.XXXXX......................................................] duration: 6.005801036s FAIL (2025-08-29 09:59:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.005822336s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 634.652553ms remote: "tcp:13.203.125.58:443" response headers: Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976b32065b9c4722-BOM Cache-Control=private Set-Cookie=_cfuvid=xF_rmhhHpyByWDUqpjWOFfOZ5a1YkydK_lbVgdeOSms-1756461564275-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 09:59:24 GMT Content-Type=text/html Content-Length=166 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:59:24 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 634.690987ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.041141832s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:59:22 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.041194082s edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 605.45863ms remote: "tcp:13.203.125.58:443" response headers: Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Age=226391 Date=Fri, 29 Aug 2025 09:59:12 GMT Cf-Ray=976b31c14eed3b07-BOM Surrogate-Control=max-age=2147483647 Vary=Accept-Encoding Set-Cookie=_cfuvid=SZGY2BBjdzsZBh2DlpQQXLV9N8GRIWsG9K9SaqtjBvs-1756461552898-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 09:59:13 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 605.483247ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 5.757130973s FAIL (2025-08-29 09:59:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.757157804s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 5.824716337s FAIL (2025-08-29 09:58:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.824736775s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 619.421178ms remote: "tcp:3.109.243.18:443" response headers: Content-Length=166 Cf-Ray=976b30f5ff0fff69-BOM Cache-Control=private Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Vary=Accept-Encoding Set-Cookie=_cfuvid=IyedyuMikZtZD3qbqK0kdBxeHDGV9HN0mEuptPKYHsY-1756461520679-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:58:40 GMT Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:58:40 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 619.442109ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 417.801384ms remote: "tcp:13.233.175.166:443" response headers: Content-Type=text/html Age=226353 Set-Cookie=_cfuvid=FXvHOlYIWLBu2g57ubEFhCY5JEEhhqZ.Z07EYN3fdHw-1756461515026-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Cache-Status=HIT Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 Cf-Ray=976b30d45fd73bf4-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Date=Fri, 29 Aug 2025 09:58:35 GMT target: https://www.storj.io/ FAIL (2025-08-29 09:58:35 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 417.826312ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..XXXXX.....................................................] duration: 5.816563345s FAIL (2025-08-29 09:58:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.81659231s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.033623746s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:58:29 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.033655547s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 5.853240926s FAIL (2025-08-29 09:58:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.853287235s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 5.827566497s FAIL (2025-08-29 09:58:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.827597026s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 1.125074646s remote: "tcp:13.233.175.166:443" response headers: Date=Fri, 29 Aug 2025 09:58:06 GMT Content-Type=text/html Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=31lYH7F2LD_UM1jAgW7fVwO51nnn9IHdW2ChyzmPvjY-1756461486594-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Content-Length=166 Cf-Ray=976b301ddd7b3e39-BOM X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:58:06 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 1.125101307s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...XXXXX....................................................] duration: 5.934294768s FAIL (2025-08-29 09:58:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.934325676s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 6.036435895s FAIL (2025-08-29 09:57:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.036452899s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 389.04487ms remote: "tcp:3.109.243.18:443" response headers: Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Set-Cookie=_cfuvid=Cq.YUOpm9Q3gpAEmQYvp0bkt4tslCkRd.qI6Xzzq.1E-1756461472167-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Ray=976b2fc89c9a483e-BOM Surrogate-Control=max-age=2147483647 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:57:52 GMT Age=225725 Content-Type=text/html Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 09:57:52 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 389.061873ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 5.935393366s FAIL (2025-08-29 09:57:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.935420107s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 6.193273391s FAIL (2025-08-29 09:57:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.193308249s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.567899861s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:57:17 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.567931262s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 5.746501613s FAIL (2025-08-29 09:57:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.746533034s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 636.783401ms remote: "tcp:13.203.125.58:443" response headers: Content-Type=text/html Content-Length=166 Cf-Ray=976b2e91be18419e-BOM Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Location=https://static.storj.io/dcs-satellites Set-Cookie=_cfuvid=DxCCVIHmIEXu25DNfb.dEZMqb.EyqQY_FJN6MlBVzwQ-1756461422738-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:57:02 GMT target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:57:02 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 636.808679ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 415.626743ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 09:57:01 GMT Content-Type=text/html Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Cf-Ray=976b2e899c673b0d-BOM Cf-Cache-Status=HIT Age=226260 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=2CVxiY3.45.Yz9yohvQlZika2HEVPPJMPntGBB5FiWk-1756461421143-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 09:57:01 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 415.643644ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 6.135352253s FAIL (2025-08-29 09:56:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.135375687s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....XXXXX...................................................] duration: 5.891081072s FAIL (2025-08-29 09:56:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.891103765s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.333784256s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:56:43 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 1.333817411s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 6.12226607s FAIL (2025-08-29 09:56:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.122290408s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 5.869453625s FAIL (2025-08-29 09:56:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.869478252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 5.894310787s FAIL (2025-08-29 09:56:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.894338018s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 645.933146ms remote: "tcp:3.109.243.18:443" response headers: Vary=Accept-Encoding Set-Cookie=_cfuvid=xAIo.Lr_OoSzGnY6qMrLCHdoUc2PovIqFKQZ9wQnOyg-1756461371483-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Content-Type=text/html Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:56:11 GMT Cf-Ray=976b2d51588b84d1-BOM Cache-Control=private target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:56:11 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 645.958275ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 630.431909ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:56:11 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 630.456387ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 417.77585ms remote: "tcp:3.109.243.18:443" response headers: Age=226197 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding Set-Cookie=_cfuvid=8TpBzSFbUu7f_jj8iyJCADUyIOgz_U7tqEp...UQx1k-1756461358448-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:55:58 GMT Cf-Ray=976b2d01fc1fff66-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 Content-Type=text/html target: https://www.storj.io/ FAIL (2025-08-29 09:55:58 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 417.797012ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....XXXXX..................................................] duration: 6.059747374s FAIL (2025-08-29 09:55:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.05977096s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 290.653097ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:55:40 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 290.679217ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 357.437766ms remote: "tcp:13.203.125.58:443" response headers: Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Age=226092 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Set-Cookie=_cfuvid=mzRn61OpRGLxs61PO7QBFvtPDHdEc3JFkqBeH8ASMSk-1756461328488-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Date=Fri, 29 Aug 2025 09:55:28 GMT Content-Type=text/html Cf-Ray=976b2c46cc1cb7e5-BOM Surrogate-Control=max-age=2147483647 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/ FAIL (2025-08-29 09:55:28 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 357.463887ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 6.182574949s FAIL (2025-08-29 09:55:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.182603544s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 377.219376ms remote: "tcp:13.233.175.166:443" response headers: Date=Fri, 29 Aug 2025 09:55:09 GMT Cf-Ray=976b2bceaf746ee3-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Set-Cookie=_cfuvid=veb6VcxSvT3E_bu8C97x0zLuM5eHo8V2fa9AA0uCYx8-1756461309284-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html Age=225534 Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Cf-Cache-Status=HIT X-Cluster-Name=ap-south-1-prod-hosting-red Vary=Accept-Encoding target: https://www.storj.io/ FAIL (2025-08-29 09:55:09 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 377.246618ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 299.488406ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:55:07 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 299.549362ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 5.717334794s FAIL (2025-08-29 09:54:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.717362066s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 647.064682ms remote: "tcp:13.233.175.166:443" response headers: Date=Fri, 29 Aug 2025 09:54:58 GMT Content-Type=text/html Cf-Ray=976b2b888c383501-BOM Cf-Cache-Status=BYPASS Vary=Accept-Encoding Set-Cookie=_cfuvid=R49E7rRsPRlMfsZpQ6ZQI11JG7qRUX8SfAIXcOJKAU0-1756461298379-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Length=166 Location=https://static.storj.io/dcs-satellites Cache-Control=private Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 09:54:58 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 647.088167ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [......XXXXX.................................................] duration: 6.0682839s FAIL (2025-08-29 09:54:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.06831464s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 5.999571421s FAIL (2025-08-29 09:54:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.99959678s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 271.285843ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:54:32 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 271.311641ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......XXXXX................................................] duration: 6.035351465s FAIL (2025-08-29 09:54:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== tItem_ObjectBegin Aug 29 09:22:46.272780438 (16h30m0.264815862s) [upload=17044]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:22:46.550202555 (16h30m0.542237988s) [seg_pos={0 0}, upload=17044]: Begin upload segment... Aug 29 09:22:46.550255777 (16h30m0.5422912s) [seg_pos={0 0}, upload=17044]: Done begin upload segment. Aug 29 09:22:46.550289992 (16h30m0.542325445s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550313797 (16h30m0.54234922s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550765893 (16h30m0.542801316s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.550996293 (16h30m0.543031727s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551064845 (16h30m0.543100258s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551356032 (16h30m0.543391455s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551476924 (16h30m0.543512357s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.551944719 (16h30m0.543980152s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552378589 (16h30m0.544414012s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.552893563 (16h30m0.544928987s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553240618 (16h30m0.545276041s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553601027 (16h30m0.54563645s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.553972438 (16h30m0.546007862s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554315095 (16h30m0.546350528s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554652931 (16h30m0.546688354s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:46.554999795 (16h30m0.547035218s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Uploading piece... Aug 29 09:22:48.457921587 (16h30m2.44995701s) [upload=17044]: Next returned nil segment Aug 29 09:22:48.457954229 (16h30m2.449989652s) [upload=17044]: Waiting for error group managing segments... Aug 29 09:22:48.756247413 (16h30m2.748282836s) [noise=true , address=45.91.116.12:4227 , piece_id=BK7AB7BAM5KLLXBQNCMYWE4BGVUCVNR75B3AJFBXLP3L7HWQBGEQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.184794715 (16h30m3.176830138s) [noise=true , address=104.36.82.6:4874 , piece_id=UK2U7DTYEXZEAV7B6GZZ6WJMLVEISTOANWV5EXSMH5TATHIWNHMQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.230559907 (16h30m3.22259533s) [noise=true , address=45.91.116.5:4297 , piece_id=GUZJNA4TES3HRJ2X5CUHIOGBV2KSMR6L6EMORO4JZPI6ZRXICNHA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:49.487978747 (16h30m3.48001417s) [noise=true , address=45.91.116.11:4119 , piece_id=WA5MNGMTKM4IUKSK6Q2IP2OGNY7FD7QGL7SX4SLK2YH277O2CDWQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:22:56.231855460 (16h30m10.223890933s) [noise=true , address=104.36.82.12:4150 , piece_id=LAS2ZU45LDL4DDEOCQ4PY5VJJ6CAFGJSFJG4IQCFOOWUNFBXFE4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:03.594352601 (16h30m17.586388024s) [noise=true , address=104.36.82.7:4911 , piece_id=C326VOSOD7Q5S5MSLFRZF4GR2LN6J5EBAHL5OH2TN4TYHWPGBS4Q, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:08.700223488 (16h30m22.692258912s) [noise=true , address=104.36.82.2:4731 , piece_id=MQCDFO275KOZG4YDM3PQDEVMAIBBRGQ2REWSGLCAIEWF6IRIZMTA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:12.130278386 (16h30m26.122313809s) [noise=true , address=104.36.82.8:4972 , piece_id=3VFXUPCSXV2EUW35BSUX5ZCXUERVOCJFA6LV754AUYDV7652FYYA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:13.171317440 (16h30m27.163352893s) [noise=true , address=104.36.82.10:4079 , piece_id=H6HAWIYCWW3OGC23P2B5MZM3U5FX4YKXYIZ6TOAHLLGQZIKISMQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: <nil> Aug 29 09:23:15.597986731 (16h30m29.590022154s) [noise=true , address=104.36.82.4:4803 , piece_id=CYSGFQXJ7TH2XULDC6SG7YN3KRKA2IMX7M4OU6SOOIHZUPPD7HQA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:104.36.82.4:4803): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598019584 (16h30m29.590055008s) [noise=true , address=104.36.82.11:4115 , piece_id=MNXFRRNT33USAUQT5QHJOAVQP4H42EXKGUXQHP3GIVWPSX4W3KGQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:23:15.598032048 (16h30m29.590067471s) [noise=true , address=45.91.116.6:4974 , piece_id=DQWT7R6BHKAP3I6SJYALGZQCTNMP6YCVIBKJXH3HQYHGQBIBRHHQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36986->45.91.116.6:4974: use of closed network connection Aug 29 09:23:15.598061835 (16h30m29.590097258s) [noise=true , address=45.91.116.4:4938 , piece_id=NPJAMZZWCVTY3AIY273LQGGZANLJQENCJV6ZIPW5VTMGA7IICPWA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33012->45.91.116.4:4938: use of closed network connection Aug 29 09:23:15.598085180 (16h30m29.590120603s) [noise=true , address=104.36.82.13:4185 , piece_id=3A6KZMFPPYOK3Z4WNXWWBZV6RFOB4BVXKURTAPSCDZACJEIUYTFA, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44618->104.36.82.13:4185: use of closed network connection Aug 29 09:23:15.598128984 (16h30m29.590164407s) [noise=true , address=77.90.31.11:4554 , piece_id=BZIM7KKRZXLRVLEHUG6Y2REB6P4O6ZX34VGLDBW2VZ7MXKRNXT5A, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33590->77.90.31.11:4554: use of closed network connection Aug 29 09:23:15.598162117 (16h30m29.59019754s) [noise=true , address=104.36.82.4:4801 , piece_id=DRUU37NHBL75CZEVD5WXDABKQFCOMVYICFQWPMXA2AOEAUTDGXUQ, seg_pos={0 0}, upload=17044]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->104.36.82.4:4801: use of closed network connection Aug 29 09:23:15.598179089 (16h30m29.590214512s) [seg_pos={0 0}, upload=17044]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 09:23:15.842266729 (16h30m29.834302153s) [upload=17044]: Done uploading segments... Aug 29 09:23:15.842303290 (16h30m29.834338713s) [upload=17044]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.03538059s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 5.855693859s FAIL (2025-08-29 09:54:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 09:21:43.531664563 (16h28m57.523699986s) [upload=17026]: Starting upload Aug 29 09:21:43.531715050 (16h28m57.523750473s) [upload=17026]: Done starting upload Aug 29 09:21:43.531803328 (16h28m57.523838751s) [upload=17026]: Uploading segments... Aug 29 09:21:43.531963074 (16h28m57.523998497s) [upload=17026]: Got next segment. Inline: false Aug 29 09:21:43.532027949 (16h28m57.524063372s) [upload=17026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 09:21:43.532037156 (16h28m57.524072579s) [upload=17026]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 09:21:44.001651865 (16h28m57.993687298s) [seg_pos={0 0}, upload=17026]: Begin upload segment... Aug 29 09:21:44.001689257 (16h28m57.99372468s) [seg_pos={0 0}, upload=17026]: Done begin upload segment. Aug 29 09:21:44.001714415 (16h28m57.993749838s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.001898977 (16h28m57.993934411s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002290708 (16h28m57.994326131s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002432459 (16h28m57.994467892s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002590642 (16h28m57.994626055s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002713837 (16h28m57.99474926s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.002887599 (16h28m57.994923022s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003000917 (16h28m57.99503634s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003161183 (16h28m57.995196606s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003294227 (16h28m57.99532966s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003491015 (16h28m57.995526438s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003582950 (16h28m57.995618373s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003819984 (16h28m57.995855407s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.003828029 (16h28m57.995863452s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004061545 (16h28m57.996096969s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004079240 (16h28m57.996114663s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004316995 (16h28m57.996352418s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:44.004845676 (16h28m57.996881099s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Uploading piece... Aug 29 09:21:45.139537965 (16h28m59.131573388s) [upload=17026]: Next returned nil segment Aug 29 09:21:45.139556530 (16h28m59.131591953s) [upload=17026]: Waiting for error group managing segments... Aug 29 09:21:45.427661343 (16h28m59.419696766s) [noise=true , address=79.127.205.245:4246 , piece_id=65RRITNH3FBTZJKLDQLLY2M75THTZMC6GDIG6GBKSITNV2SGPU7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.843199586 (16h28m59.835235009s) [noise=true , address=79.127.220.97:4375 , piece_id=ZRLXHAZGZT5JNAILIVHBSYDYJKYC7RUMGDOFGVNHABJEJSWF4MYA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.905309602 (16h28m59.897345025s) [noise=true , address=79.127.219.48:4074 , piece_id=EDJN5XXMBXE456KFMMARNP44YUXXQHHI3SFOWGZCOGNENCFYOYZA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:45.990426703 (16h28m59.982462126s) [noise=true , address=156.146.43.225:4445 , piece_id=UQIX7SKP7ACZ6SGK726G4AQXP5243U2EQGZINYGQP7X2VZ3XT4KQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:46.104456075 (16h29m0.096491498s) [noise=true , address=77.90.31.10:4532 , piece_id=W635Y3NRUM52AXDBHKSHRBCGFMP6UXWTJPKDJSDZDDB3CH4EQEHA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:21:48.012494897 (16h29m2.00453032s) [noise=true , address=45.91.116.5:4317 , piece_id=ZP7WEDMXJ4IHMDWJFHXWB4DA4OP3HFT54SJKK2WE35BROBGP6GDA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:07.455072263 (16h29m21.447107696s) [noise=true , address=64.49.13.138:4486 , piece_id=ES2VY23J732JI77XK7EF4ID3RVUE52DGIDKJ5WTBIVFL2T75IPJQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:10.162273788 (16h29m24.154309242s) [noise=true , address=104.36.82.44:4894 , piece_id=E7FMBNAUYZG4SD44DQQJ252F6DYZJACECYFF5RV2KLEWLMNWRQTQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:34.956032767 (16h29m48.94806819s) [noise=true , address=77.90.31.13:4643 , piece_id=S5UEXKRZVBBYFOROKNPJRF2Y7NXRZEGJLGHQ4MMPUCZKQO32DISA, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:39.420476622 (16h29m53.412512035s) [noise=true , address=77.90.31.18:4829 , piece_id=KCUM2WXQTNKV2JJYAFRTE5FJCOJ6LIG5BCC4MG6HZUMRX2UHYAFQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: <nil> Aug 29 09:22:42.846092596 (16h29m56.838128019s) [noise=true , address=45.91.116.9:4270 , piece_id=FOK35CCEVQUQLYZBEJO5I3AFADTBD7KXH5NSAAY67J6XYW72ATWQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846186276 (16h29m56.838221699s) [noise=true , address=77.90.31.12:4616 , piece_id=WSG7TKGO7VBZJWHI26Z5FWLCIKSXIUP4C6SZG5P6P4HYWLX4MNPQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35118->77.90.31.12:4616: use of closed network connection Aug 29 09:22:42.846243295 (16h29m56.838278718s) [noise=true , address=77.90.31.21:4887 , piece_id=4Z7P763HCUGPQTQKFJYZRIX3DOL5TRK5KCUSIEZXG2TYM6VBUW5A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846347944 (16h29m56.838383367s) [noise=true , address=104.36.82.44:4890 , piece_id=CR4DCJQ5QAEMMXBIHKEKALUMLXMGZ5S3GNNUFUD3PY7BUAD3CH4A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M, address:104.36.82.44:4890): protocol: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45232->104.36.82.44:4890: use of closed network connection Aug 29 09:22:42.846358946 (16h29m56.838394369s) [noise=true , address=104.36.82.51:4061 , piece_id=POHNKZ4VJNZL3VS2SFUSTK45ZK6RUKMLIIUPVFH2FGXEAWELWXCQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:104.36.82.51:4061): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846406477 (16h29m56.8384419s) [noise=true , address=77.90.31.18:4840 , piece_id=WVRVKJPPQY4PR6HGRPR4ZBSHCPPEB2JWEFTIFE3W2CLNTI2KPMGQ, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59596->77.90.31.18:4840: use of closed network connection Aug 29 09:22:42.846438388 (16h29m56.838473811s) [noise=true , address=45.91.116.13:4176 , piece_id=AOVHKUOJQYSZ6BUYUIIM7PNGFCET6LAUDP3UE4ATFRQTGEHJBE7Q, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59366->45.91.116.13:4176: use of closed network connection Aug 29 09:22:42.846458597 (16h29m56.83849402s) [noise=true , address=77.90.31.17:4793 , piece_id=G4XQUYPSQJXWCBET2MN7EHPDETAPEW22CQPW5M5KKZNT7WUNUQ7A, seg_pos={0 0}, upload=17026]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:42.846484866 (16h29m56.838520299s) [seg_pos={0 0}, upload=17026]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:43.086688516 (16h29m57.078723939s) [upload=17026]: Done uploading segments... Aug 29 09:22:43.086719746 (16h29m57.078755169s) [upload=17026]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.855723327s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 516.340555ms remote: "tcp:13.233.175.166:443" response headers: Date=Fri, 29 Aug 2025 09:54:16 GMT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Set-Cookie=_cfuvid=OKuTgYgFbvzU5vAa7E_eAeqV1zutAnc9FjeJIUn4Z2M-1756461256111-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html Age=225711 Cf-Ray=976b2a8179084200-BOM Surrogate-Control=max-age=2147483647 target: https://www.storj.io/ FAIL (2025-08-29 09:54:16 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 516.375943ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.209051424s remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-29 09:54:14 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 2.209104636s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 5.860714139s FAIL (2025-08-29 09:54:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== WLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302132062 (16h28m27.294167485s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302430333 (16h28m27.294465766s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.302800130 (16h28m27.294835553s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303032164 (16h28m27.295067587s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303357847 (16h28m27.295393271s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303601564 (16h28m27.295636987s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.303823729 (16h28m27.295859152s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304042528 (16h28m27.296077951s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304293778 (16h28m27.296329201s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304549497 (16h28m27.29658492s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.304804456 (16h28m27.296839889s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305020208 (16h28m27.297055631s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305224760 (16h28m27.297260183s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:13.305336864 (16h28m27.297372287s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Uploading piece... Aug 29 09:21:14.435253386 (16h28m28.427288809s) [upload=17020]: Next returned nil segment Aug 29 09:21:14.435275759 (16h28m28.427311182s) [upload=17020]: Waiting for error group managing segments... Aug 29 09:21:14.730270886 (16h28m28.722306319s) [noise=true , address=79.127.205.245:4250 , piece_id=2BEOH3XQ7KWI6AWII7OYL4UUAVMPGGOIL2ABZ4IOJECJGHXZHQSQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.263983845 (16h28m29.256019268s) [noise=true , address=45.91.116.8:4060 , piece_id=J7U3XRYXKNZ7CNFV3ZS56MTDNEI5IOMWBXJMKXK45LE6CW3TA4BA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.270753950 (16h28m29.262789373s) [noise=true , address=45.91.116.4:4952 , piece_id=NIPBHNGF3PJTACRZEIGIXREYI3VAVWRZDW76R5BS55F2SQLXDV2A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.286596695 (16h28m29.278632118s) [noise=true , address=79.127.219.48:4074 , piece_id=KAKTBNYLP7JQHJCARXYWMTKMOFZMDPBK4JSJSSAJMZYY4JQUUEUQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.326558230 (16h28m29.318593663s) [noise=true , address=77.90.31.15:4708 , piece_id=3357F3P67HGOJXCINV5OPGPVN3INWRFW73N5AAZBKAYHWW7RQZQQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.415754717 (16h28m29.40779015s) [noise=true , address=104.36.82.44:4895 , piece_id=C57N4ZPZOPVJ534PPVRXADXXBMRS2PFGMQ6PHP5LAYUXWJHFAU7Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:15.514815608 (16h28m29.506851031s) [noise=true , address=156.146.43.225:4446 , piece_id=K2TIKDEUZAQFC2AWKKFRKLBQUS5HECJZYIG5JAOXNOZXCFF74KLA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.219577645 (16h28m30.211613068s) [noise=true , address=77.90.31.19:4860 , piece_id=KMJ7PZ6NYASPJNGLDM2I6WSD6ZXPYJCKKPLAK2HVLFVPJQ4GD7NA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:16.610681064 (16h28m30.602716487s) [noise=true , address=104.36.82.23:4446 , piece_id=ICFIFZP2RJNMKKOMTZKUQD2Z5DMRKQWMQJH44LHEEMCSQDTYNL6Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:21:43.141334315 (16h28m57.133369738s) [noise=true , address=77.90.31.17:4798 , piece_id=3VCDXZZDUQQB4AUEF3FXM4IZFVMIYTURBZKHMPETT27QYWUODE3Q, seg_pos={0 0}, upload=17020]: Done uploading piece. err: <nil> Aug 29 09:22:12.157203546 (16h29m26.149238969s) [noise=true , address=104.36.82.5:4872 , piece_id=EPXEMSWGS7VCQM2I5ZZBEXVFXRFLIDZGSGY65PF53WLCOV7RX6OA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: expected piece hash; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:42866->104.36.82.5:4872: use of closed network connection; EOF Aug 29 09:22:12.157307074 (16h29m26.149342497s) [noise=true , address=45.91.116.11:4129 , piece_id=M3PSUCLC4UR3JV3MZGUH52MMGGZQAE4MCVYKVGIZT3SVBPZ4C7UA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1G1vKtMNbawZnTDutUimTNy3L1UG75hzEvKrgJEs1rXS8Z956X, address:45.91.116.11:4129): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157333655 (16h29m26.149369078s) [noise=true , address=104.36.82.5:4852 , piece_id=GM4HG7DPBJNNLAE7BABCUDA4CG4J6MEOQMWLN6IB6DFO47NUJZTA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: expected piece hash; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; write tcp 188.166.225.170:38658->104.36.82.5:4852: use of closed network connection; EOF Aug 29 09:22:12.157433376 (16h29m26.149468799s) [noise=true , address=77.90.31.12:4596 , piece_id=XE7XXC36JM7ITVKWILC6HGJZGYKP3FWTIPC3U7RPYYZLL4UR7ELA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 09:22:12.157443636 (16h29m26.149479059s) [noise=true , address=77.90.31.13:4654 , piece_id=FOWKH6HPKWU52INYEWLETFYTYNELWQGBYVNV5QIUS6UIHOG5ZWEA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41374->77.90.31.13:4654: use of closed network connection Aug 29 09:22:12.157531644 (16h29m26.149567067s) [noise=true , address=45.91.116.7:4013 , piece_id=7J5BHRRTTAAOP6TLKD7TWATIJPZKC6NUM4PPXGX5FB7ZRZDH5S5A, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:121bMz2UYi9i53u7ss3SULotcCmAQVhXbNPFr4Hk7XGdgHeVQMw, address:45.91.116.7:4013): protocol: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39684->45.91.116.7:4013: use of closed network connection Aug 29 09:22:12.157542866 (16h29m26.149578289s) [noise=true , address=77.90.31.10:4540 , piece_id=VSBS5L4IP2ML5BK7ZPKPIYZ2YO2EY6X7ONEYGVSES7I2NDBXYQXQ, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:1UUkKs1GGD9A6byJ1ZNZuZoX4kaa6zAdAKsaKs8bZ5A2jsxreA, address:77.90.31.10:4540): protocol: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46598->77.90.31.10:4540: use of closed network connection Aug 29 09:22:12.157614081 (16h29m26.149649505s) [noise=true , address=77.90.31.16:4752 , piece_id=6TEI5ZHVL553QCTEASUMCXZSPEQAGMCD7MT2RM5WVUXS5QXCS3HA, seg_pos={0 0}, upload=17020]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50904->77.90.31.16:4752: use of closed network connection Aug 29 09:22:12.157637076 (16h29m26.149672499s) [seg_pos={0 0}, upload=17020]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 09:22:12.398454374 (16h29m26.390489797s) [upload=17020]: Done uploading segments... Aug 29 09:22:12.398485203 (16h29m26.390520626s) [upload=17020]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.86074095s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 429.248819ms remote: "tcp:3.109.243.18:443" response headers: X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Set-Cookie=_cfuvid=7vnY9WNy97m_Upb0rfsqjD3ke9zaZyga3cpRK.DljnE-1756461237334-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Ray=976b2a0c9da33cb8-BOM Age=226076 Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 09:53:57 GMT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Content-Type=text/html Cf-Cache-Status=HIT Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 target: https://www.storj.io/ FAIL (2025-08-29 09:53:57 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 429.271633ms core website

Orbiter Check History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)