Orbiter History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 264.897548ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/45c08147c7083bce FAIL (2025-12-09 01:09:17 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout Duration: 264.923166ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 473.159301ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7 FAIL (2025-12-09 01:09:17 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 473.18447ms core satellite eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 20.587423ms target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/af91489e18f8dd7 FAIL (2025-12-09 01:09:17 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 20.613882ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.744715901s trace: https://jaeger.dev.storj.io/trace/16f5f0214b7e09da FAIL (2025-12-09 01:09:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment Dec 9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments... Dec 9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789 , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces. Dec 9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments... Dec 9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.744744634s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.775697222s trace: https://jaeger.dev.storj.io/trace/61e1f15b0de53a06 FAIL (2025-12-09 01:09:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 01:05:04.077327412 (81h36m3.948410457s) [upload=71299]: Starting upload Dec 9 01:05:04.077479422 (81h36m3.948562467s) [upload=71299]: Done starting upload Dec 9 01:05:04.077564383 (81h36m3.948647428s) [upload=71299]: Uploading segments... Dec 9 01:05:04.077964444 (81h36m3.94904751s) [upload=71299]: Got next segment. Inline: false Dec 9 01:05:04.078021453 (81h36m3.949104498s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 01:05:04.078029158 (81h36m3.949112203s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 01:05:04.325093769 (81h36m4.196176814s) [seg_pos={0 0}, upload=71299]: Begin upload segment... Dec 9 01:05:04.325151339 (81h36m4.196234384s) [seg_pos={0 0}, upload=71299]: Done begin upload segment. Dec 9 01:05:04.325193429 (81h36m4.196276474s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325308208 (81h36m4.196391253s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325950250 (81h36m4.197033296s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326217961 (81h36m4.197301006s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326682044 (81h36m4.197765089s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327265615 (81h36m4.19834867s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327577640 (81h36m4.198660695s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327710382 (81h36m4.198793428s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328164918 (81h36m4.199247963s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328390287 (81h36m4.199473332s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.329537922 (81h36m4.200620967s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.330251962 (81h36m4.201335017s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.331349081 (81h36m4.202432126s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.332272459 (81h36m4.203355504s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.333587923 (81h36m4.204670969s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.334281264 (81h36m4.205364319s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:06.034632558 (81h36m5.905715603s) [upload=71299]: Next returned nil segment Dec 9 01:05:06.034650011 (81h36m5.905733076s) [upload=71299]: Waiting for error group managing segments... Dec 9 01:05:06.319986357 (81h36m6.191069402s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.320738881 (81h36m6.191821926s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.338113855 (81h36m6.20919689s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.341292378 (81h36m6.212375443s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.344156311 (81h36m6.215239356s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.351339228 (81h36m6.222422273s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.368700567 (81h36m6.239783612s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.377863905 (81h36m6.248947842s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379184129 (81h36m6.250267175s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379479442 (81h36m6.250562487s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.381106200 (81h36m6.252189245s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.383767567 (81h36m6.254850613s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384630530 (81h36m6.255713575s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384645910 (81h36m6.255728955s) [seg_pos={0 0}, upload=71299]: Segment reached optimal threshold of 13 pieces. Dec 9 01:05:06.384857132 (81h36m6.255940177s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.384864836 (81h36m6.255947881s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385129441 (81h36m6.256212486s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWaXPeH6XghWc64oeseaM52Tk2PQZWDDj1nVnYikHGz7PwEQ3): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385137355 (81h36m6.256220401s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385319712 (81h36m6.256402768s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385328579 (81h36m6.256411624s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385349710 (81h36m6.256432755s) [seg_pos={0 0}, upload=71299]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 01:05:06.385438259 (81h36m6.256521304s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:05:06.385444030 (81h36m6.256527065s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:06:21.620112808 (81h37m21.491195853s) [upload=71299]: Done uploading segments... Dec 9 01:06:21.620261752 (81h37m21.491344807s) [upload=71299]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.775732599s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 20.14039ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/d6823dba42570ec FAIL (2025-12-09 01:09:07 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout Duration: 20.238357ms edge gateway vhost bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.098852113s trace: https://jaeger.dev.storj.io/trace/2744e7e74333fadd FAIL (2025-12-09 01:09:07 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout Duration: 1.098878823s edge authservice http bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 698.986694ms target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/200ebca2a36ec82e FAIL (2025-12-09 01:09:00 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 699.015227ms edge linksharing bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [..........XX................X.........X.X...X.X.X....XX.....] duration: 3.509132407s trace: https://jaeger.dev.storj.io/trace/24b38e2e3305fb54 FAIL (2025-12-09 01:09:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.509159108s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.151011362s trace: https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d FAIL (2025-12-09 01:08:55 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout Duration: 1.151040948s edge authservice http bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 240.229163ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/64025b92da229a61 FAIL (2025-12-09 01:08:53 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout Duration: 240.259202ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 477.567126ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7 FAIL (2025-12-09 01:08:49 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 477.597824ms core satellite eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 297.539844ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/45c08147c7083bce FAIL (2025-12-09 01:08:48 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout Duration: 297.570983ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 262.633104ms target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0 FAIL (2025-12-09 01:08:39 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 262.659365ms edge linksharing bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.159711129s trace: https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d FAIL (2025-12-09 01:08:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout Duration: 1.15988585s edge authservice http bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..X...............................] duration: 5.260270076s trace: https://jaeger.dev.storj.io/trace/44eba3f11f79732e FAIL (2025-12-09 01:08:31 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.260306274s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.705856737s trace: https://jaeger.dev.storj.io/trace/61e1f15b0de53a06 FAIL (2025-12-09 01:08:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 01:05:04.077327412 (81h36m3.948410457s) [upload=71299]: Starting upload Dec 9 01:05:04.077479422 (81h36m3.948562467s) [upload=71299]: Done starting upload Dec 9 01:05:04.077564383 (81h36m3.948647428s) [upload=71299]: Uploading segments... Dec 9 01:05:04.077964444 (81h36m3.94904751s) [upload=71299]: Got next segment. Inline: false Dec 9 01:05:04.078021453 (81h36m3.949104498s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 01:05:04.078029158 (81h36m3.949112203s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 01:05:04.325093769 (81h36m4.196176814s) [seg_pos={0 0}, upload=71299]: Begin upload segment... Dec 9 01:05:04.325151339 (81h36m4.196234384s) [seg_pos={0 0}, upload=71299]: Done begin upload segment. Dec 9 01:05:04.325193429 (81h36m4.196276474s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325308208 (81h36m4.196391253s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325950250 (81h36m4.197033296s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326217961 (81h36m4.197301006s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326682044 (81h36m4.197765089s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327265615 (81h36m4.19834867s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327577640 (81h36m4.198660695s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327710382 (81h36m4.198793428s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328164918 (81h36m4.199247963s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328390287 (81h36m4.199473332s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.329537922 (81h36m4.200620967s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.330251962 (81h36m4.201335017s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.331349081 (81h36m4.202432126s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.332272459 (81h36m4.203355504s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.333587923 (81h36m4.204670969s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.334281264 (81h36m4.205364319s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:06.034632558 (81h36m5.905715603s) [upload=71299]: Next returned nil segment Dec 9 01:05:06.034650011 (81h36m5.905733076s) [upload=71299]: Waiting for error group managing segments... Dec 9 01:05:06.319986357 (81h36m6.191069402s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.320738881 (81h36m6.191821926s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.338113855 (81h36m6.20919689s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.341292378 (81h36m6.212375443s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.344156311 (81h36m6.215239356s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.351339228 (81h36m6.222422273s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.368700567 (81h36m6.239783612s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.377863905 (81h36m6.248947842s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379184129 (81h36m6.250267175s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379479442 (81h36m6.250562487s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.381106200 (81h36m6.252189245s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.383767567 (81h36m6.254850613s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384630530 (81h36m6.255713575s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384645910 (81h36m6.255728955s) [seg_pos={0 0}, upload=71299]: Segment reached optimal threshold of 13 pieces. Dec 9 01:05:06.384857132 (81h36m6.255940177s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.384864836 (81h36m6.255947881s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385129441 (81h36m6.256212486s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWaXPeH6XghWc64oeseaM52Tk2PQZWDDj1nVnYikHGz7PwEQ3): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385137355 (81h36m6.256220401s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385319712 (81h36m6.256402768s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385328579 (81h36m6.256411624s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385349710 (81h36m6.256432755s) [seg_pos={0 0}, upload=71299]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 01:05:06.385438259 (81h36m6.256521304s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:05:06.385444030 (81h36m6.256527065s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:06:21.620112808 (81h37m21.491195853s) [upload=71299]: Done uploading segments... Dec 9 01:06:21.620261752 (81h37m21.491344807s) [upload=71299]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.705881743s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 688.091257ms target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/200ebca2a36ec82e FAIL (2025-12-09 01:08:21 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 688.112617ms edge linksharing bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [...........XX................X.........X.X...X.X.X....XX....] duration: 3.421888098s trace: https://jaeger.dev.storj.io/trace/24b38e2e3305fb54 FAIL (2025-12-09 01:08:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.421913587s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............X.....................................X.......] duration: 6.008810479s trace: https://jaeger.dev.storj.io/trace/4af262587d92cfcb FAIL (2025-12-09 01:08:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.008828984s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.122495854s trace: https://jaeger.dev.storj.io/trace/2744e7e74333fadd FAIL (2025-12-09 01:08:09 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout Duration: 1.12252516s edge authservice http bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 22.918801ms target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/af91489e18f8dd7 FAIL (2025-12-09 01:08:06 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 22.949719ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.833968497s trace: https://jaeger.dev.storj.io/trace/16f5f0214b7e09da FAIL (2025-12-09 01:08:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment Dec 9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments... Dec 9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789 , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces. Dec 9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments... Dec 9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.833997994s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.725258769s trace: https://jaeger.dev.storj.io/trace/61e1f15b0de53a06 FAIL (2025-12-09 01:07:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 01:05:04.077327412 (81h36m3.948410457s) [upload=71299]: Starting upload Dec 9 01:05:04.077479422 (81h36m3.948562467s) [upload=71299]: Done starting upload Dec 9 01:05:04.077564383 (81h36m3.948647428s) [upload=71299]: Uploading segments... Dec 9 01:05:04.077964444 (81h36m3.94904751s) [upload=71299]: Got next segment. Inline: false Dec 9 01:05:04.078021453 (81h36m3.949104498s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 01:05:04.078029158 (81h36m3.949112203s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 01:05:04.325093769 (81h36m4.196176814s) [seg_pos={0 0}, upload=71299]: Begin upload segment... Dec 9 01:05:04.325151339 (81h36m4.196234384s) [seg_pos={0 0}, upload=71299]: Done begin upload segment. Dec 9 01:05:04.325193429 (81h36m4.196276474s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325308208 (81h36m4.196391253s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325950250 (81h36m4.197033296s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326217961 (81h36m4.197301006s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326682044 (81h36m4.197765089s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327265615 (81h36m4.19834867s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327577640 (81h36m4.198660695s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327710382 (81h36m4.198793428s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328164918 (81h36m4.199247963s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328390287 (81h36m4.199473332s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.329537922 (81h36m4.200620967s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.330251962 (81h36m4.201335017s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.331349081 (81h36m4.202432126s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.332272459 (81h36m4.203355504s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.333587923 (81h36m4.204670969s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.334281264 (81h36m4.205364319s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:06.034632558 (81h36m5.905715603s) [upload=71299]: Next returned nil segment Dec 9 01:05:06.034650011 (81h36m5.905733076s) [upload=71299]: Waiting for error group managing segments... Dec 9 01:05:06.319986357 (81h36m6.191069402s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.320738881 (81h36m6.191821926s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.338113855 (81h36m6.20919689s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.341292378 (81h36m6.212375443s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.344156311 (81h36m6.215239356s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.351339228 (81h36m6.222422273s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.368700567 (81h36m6.239783612s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.377863905 (81h36m6.248947842s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379184129 (81h36m6.250267175s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379479442 (81h36m6.250562487s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.381106200 (81h36m6.252189245s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.383767567 (81h36m6.254850613s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384630530 (81h36m6.255713575s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384645910 (81h36m6.255728955s) [seg_pos={0 0}, upload=71299]: Segment reached optimal threshold of 13 pieces. Dec 9 01:05:06.384857132 (81h36m6.255940177s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.384864836 (81h36m6.255947881s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385129441 (81h36m6.256212486s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWaXPeH6XghWc64oeseaM52Tk2PQZWDDj1nVnYikHGz7PwEQ3): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385137355 (81h36m6.256220401s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385319712 (81h36m6.256402768s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385328579 (81h36m6.256411624s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385349710 (81h36m6.256432755s) [seg_pos={0 0}, upload=71299]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 01:05:06.385438259 (81h36m6.256521304s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:05:06.385444030 (81h36m6.256527065s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:06:21.620112808 (81h37m21.491195853s) [upload=71299]: Done uploading segments... Dec 9 01:06:21.620261752 (81h37m21.491344807s) [upload=71299]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.72528538s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 243.281747ms target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/200ebca2a36ec82e FAIL (2025-12-09 01:07:58 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 243.316203ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 23.70028ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/d6823dba42570ec FAIL (2025-12-09 01:07:56 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout Duration: 23.731388ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 262.82987ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/45c08147c7083bce FAIL (2025-12-09 01:07:51 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout Duration: 262.870468ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 473.872821ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7 FAIL (2025-12-09 01:07:49 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 473.910322ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..X..............................] duration: 5.093134361s trace: https://jaeger.dev.storj.io/trace/44eba3f11f79732e FAIL (2025-12-09 01:07:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.093167773s core uplink eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 246.194526ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/64025b92da229a61 FAIL (2025-12-09 01:07:40 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout Duration: 246.218631ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [............XX................X.........X.X...X.X.X....XX...] duration: 3.37228169s trace: https://jaeger.dev.storj.io/trace/24b38e2e3305fb54 FAIL (2025-12-09 01:07:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.372306136s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 8.601363537s trace: https://jaeger.dev.storj.io/trace/61e1f15b0de53a06 FAIL (2025-12-09 01:07:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 01:05:04.077327412 (81h36m3.948410457s) [upload=71299]: Starting upload Dec 9 01:05:04.077479422 (81h36m3.948562467s) [upload=71299]: Done starting upload Dec 9 01:05:04.077564383 (81h36m3.948647428s) [upload=71299]: Uploading segments... Dec 9 01:05:04.077964444 (81h36m3.94904751s) [upload=71299]: Got next segment. Inline: false Dec 9 01:05:04.078021453 (81h36m3.949104498s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 01:05:04.078029158 (81h36m3.949112203s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 01:05:04.325093769 (81h36m4.196176814s) [seg_pos={0 0}, upload=71299]: Begin upload segment... Dec 9 01:05:04.325151339 (81h36m4.196234384s) [seg_pos={0 0}, upload=71299]: Done begin upload segment. Dec 9 01:05:04.325193429 (81h36m4.196276474s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325308208 (81h36m4.196391253s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.325950250 (81h36m4.197033296s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326217961 (81h36m4.197301006s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.326682044 (81h36m4.197765089s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327265615 (81h36m4.19834867s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327577640 (81h36m4.198660695s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.327710382 (81h36m4.198793428s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328164918 (81h36m4.199247963s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.328390287 (81h36m4.199473332s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.329537922 (81h36m4.200620967s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.330251962 (81h36m4.201335017s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.331349081 (81h36m4.202432126s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.332272459 (81h36m4.203355504s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.333587923 (81h36m4.204670969s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:04.334281264 (81h36m4.205364319s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Uploading piece... Dec 9 01:05:06.034632558 (81h36m5.905715603s) [upload=71299]: Next returned nil segment Dec 9 01:05:06.034650011 (81h36m5.905733076s) [upload=71299]: Waiting for error group managing segments... Dec 9 01:05:06.319986357 (81h36m6.191069402s) [noise=true , address=145.79.227.22:4511 , piece_id=H7ZL44YXQPQ3MDIYFV2J5ID6SQAKGEDZ4QYIVJNVJVUJZXPEA5NQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.320738881 (81h36m6.191821926s) [noise=true , address=145.79.227.24:4583 , piece_id=XSMQMWNH4ZB2CKZVNFONMZI37UD7U7VYBT3NCXCOQJYVQ7KG73PQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.338113855 (81h36m6.20919689s) [noise=true , address=145.79.227.40:4050 , piece_id=TRRVNKZDEZOELFC2J5ILRGGVQ7FMFGNF7KY4K73PDHHEATNGNMAA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.341292378 (81h36m6.212375443s) [noise=true , address=145.79.227.25:4617 , piece_id=VAWH3IVQTJGP4RR635W7MUQQ6PE4JU65PI4F2RTNVEXHAQRQ7CZQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.344156311 (81h36m6.215239356s) [noise=true , address=145.79.227.31:4799 , piece_id=E6HPGN2U4POXUGUUZ7YJN5WDB7Q3YO34BXDQYVJD32PZSJ5APYKQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.351339228 (81h36m6.222422273s) [noise=true , address=145.79.227.22:4509 , piece_id=JRN2BT5YNORGFNP2JZJLIXCEYJOPNTIVLSHLGX4OCG5PCUQOFO3A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.368700567 (81h36m6.239783612s) [noise=true , address=145.79.227.20:4438 , piece_id=PCSNROLMD3UBUHJCGIKATYJJ4LC7Y433MHPFJOCQ2VEZRHI5OC4Q, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.377863905 (81h36m6.248947842s) [noise=true , address=145.79.227.29:4941 , piece_id=MELXRUKLN2YFQYIP6BSP5A2K35XRZGABISUEAIGGXFWJNRNTLGDA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379184129 (81h36m6.250267175s) [noise=true , address=145.79.227.16:4910 , piece_id=3MZ42IEHE6MEUZB2MFQCPT4TE5PJBLXKWHXISRKUSWXDA45P2NFQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.379479442 (81h36m6.250562487s) [noise=true , address=145.79.227.43:4159 , piece_id=DFUORMG2PBZFQXWO4WVYJENGJ7HTGHRAPGIH67LGEILW7BILL3HA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.381106200 (81h36m6.252189245s) [noise=true , address=145.79.227.40:4051 , piece_id=XHFYGRPQY7WNYXPX6CY5AUR44SLX2VXQ4MYBE6CYS4OB4RSDMKHA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.383767567 (81h36m6.254850613s) [noise=true , address=145.79.227.33:4870 , piece_id=IBO52LP3RMQQ2U7FYIE6D4LZWOZBTONF2CI3TWVIEUTBT2BGE3EA, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384630530 (81h36m6.255713575s) [noise=true , address=145.79.227.42:4123 , piece_id=BGMQ77X5SJLPQIGM3NS5RGEOIDTECOVR6WKXZQE3XXR7VYTUVL2A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: <nil> Dec 9 01:05:06.384645910 (81h36m6.255728955s) [seg_pos={0 0}, upload=71299]: Segment reached optimal threshold of 13 pieces. Dec 9 01:05:06.384857132 (81h36m6.255940177s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.384864836 (81h36m6.255947881s) [noise=true , address=145.79.227.16:4911 , piece_id=2N46POUCRXNPQCWLHPGHVHAMKLEBPCCMXEQVCKEOYXSJN5EAB62A, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385129441 (81h36m6.256212486s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWaXPeH6XghWc64oeseaM52Tk2PQZWDDj1nVnYikHGz7PwEQ3): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385137355 (81h36m6.256220401s) [noise=true , address=145.79.227.28:4727 , piece_id=Q7KQPCLR24AEZPUORAZ2DRL4O5JOVD6KLYOVGO64X2MRQ57SC2DQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385319712 (81h36m6.256402768s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Dec 9 01:05:06.385328579 (81h36m6.256411624s) [noise=true , address=45.91.116.5:4298 , piece_id=CZ6QNFBQGUZLIUT56O7LF3VHXZUEVYMXHX74K4YWAJYRJEI4W6SQ, seg_pos={0 0}, upload=71299]: Long tail cancellation due to optimal threshold Dec 9 01:05:06.385349710 (81h36m6.256432755s) [seg_pos={0 0}, upload=71299]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 9 01:05:06.385438259 (81h36m6.256521304s) [upload=71299]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:05:06.385444030 (81h36m6.256527065s) [upload=71299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:06:21.620112808 (81h37m21.491195853s) [upload=71299]: Done uploading segments... Dec 9 01:06:21.620261752 (81h37m21.491344807s) [upload=71299]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.601394125s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.152038579s trace: https://jaeger.dev.storj.io/trace/2744e7e74333fadd FAIL (2025-12-09 01:07:34 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout Duration: 1.152068335s edge authservice http bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 23.655984ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/d6823dba42570ec FAIL (2025-12-09 01:07:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout Duration: 23.683168ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 266.11769ms target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0 FAIL (2025-12-09 01:07:30 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 266.913847ms edge linksharing bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.180994023s trace: https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d FAIL (2025-12-09 01:07:26 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout Duration: 1.181020433s edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.905403745s trace: https://jaeger.dev.storj.io/trace/16f5f0214b7e09da FAIL (2025-12-09 01:07:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece... Dec 9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment Dec 9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments... Dec 9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789 , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil> Dec 9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces. Dec 9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF Dec 9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold Dec 9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments... Dec 9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.905430806s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 249.293094ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/64025b92da229a61 FAIL (2025-12-09 01:07:17 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout Duration: 249.32738ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..X.............................] duration: 5.52930991s trace: https://jaeger.dev.storj.io/trace/44eba3f11f79732e FAIL (2025-12-09 01:07:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.529342272s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.353357011s trace: https://jaeger.dev.storj.io/trace/2744e7e74333fadd FAIL (2025-12-09 01:07:14 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout Duration: 1.353375806s edge authservice http bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 25.699997ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/d6823dba42570ec FAIL (2025-12-09 01:07:03 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout Duration: 25.73304ms edge gateway vhost bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............X.....................................X......] duration: 5.678389984s trace: https://jaeger.dev.storj.io/trace/4af262587d92cfcb FAIL (2025-12-09 01:07:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.678451381s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 23.762647ms target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/af91489e18f8dd7 FAIL (2025-12-09 01:06:59 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 23.792084ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 257.126581ms target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/200ebca2a36ec82e FAIL (2025-12-09 01:06:58 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 257.154274ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 273.326177ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/45c08147c7083bce FAIL (2025-12-09 01:06:56 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout Duration: 273.356806ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 475.844234ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7 FAIL (2025-12-09 01:06:50 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 475.884632ms core satellite eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 271.378148ms target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0 FAIL (2025-12-09 01:06:46 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout Duration: 271.403686ms edge linksharing bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [.............XX................X.........X.X...X.X.X....XX..] duration: 3.512450003s trace: https://jaeger.dev.storj.io/trace/24b38e2e3305fb54 FAIL (2025-12-09 01:06:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.512478108s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 481.741052ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7 FAIL (2025-12-09 01:06:34 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 481.858406ms core satellite eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 267.150417ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/64025b92da229a61 FAIL (2025-12-09 01:06:34 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout Duration: 267.181557ms edge gateway vhost bgp eu1

Orbiter Check History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)