Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [..XX........XXXXXXXXXXXXXXXXXXXXXXXX........................] duration: 5.647729179s FAIL (2025-08-29 08:11:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.647768744s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 990.356943ms remote: "tcp:3.109.243.18:443" response headers: Date=Fri, 29 Aug 2025 08:11:41 GMT Content-Type=text/html Content-Length=166 Cf-Ray=976a943d090a84bf-BOM Cache-Control=private Vary=Accept-Encoding Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Set-Cookie=_cfuvid=FiRYIH5oM1ZwXBHMA7qfgeC9tuNvEIFM2.ihOLQTUJk-1756455101347-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:11:41 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 990.38076ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [......XX.......XXXXXXXXXXXXXXXXXXXXXXX......................] duration: 5.924719297s FAIL (2025-08-29 08:11:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.924744727s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 636.116572ms remote: "tcp:13.233.175.166:443" response headers: Set-Cookie=_cfuvid=G9f3lEd0jR8B7lW77xvXLLrm1.NgqMqdwH5PCdNtlEY-1756455069092-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Content-Length=166 Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:11:09 GMT Content-Type=text/html Location=https://static.storj.io/dcs-satellites Cf-Ray=976a93737adf3b13-BOM Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:11:09 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 636.140617ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [.......XX.......XXXXXXXXXXXXXXXXXXXXXXX.....................] duration: 5.958117868s FAIL (2025-08-29 08:11:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.958148046s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 410.467442ms remote: "tcp:13.233.175.166:443" response headers: Date=Fri, 29 Aug 2025 08:11:01 GMT Content-Type=text/html Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 Cf-Ray=976a9344fdcc4737-BOM Age=219314 Surrogate-Control=max-age=2147483647 Vary=Accept-Encoding Set-Cookie=_cfuvid=nSsS0bAasNQ2ZwJCCHhZzK8ZnY9Wjj4yt_RAL18XBHs-1756455061352-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/ FAIL (2025-08-29 08:11:01 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 410.494524ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX....................] duration: 6.365306502s FAIL (2025-08-29 08:10:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.365345418s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [...XX........XXXXXXXXXXXXXXXXXXXXXXXX.......................] duration: 5.790517402s FAIL (2025-08-29 08:10:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.790556796s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 371.430958ms remote: "tcp:3.109.243.18:443" response headers: Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding Set-Cookie=_cfuvid=BbtVemchaS3pqHqVudg.j2BtlwGFHq9KR2koM36rx.0-1756455042934-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Cf-Ray=976a92d1fdb98555-BOM Age=219927 Surrogate-Control=max-age=2147483647 Date=Fri, 29 Aug 2025 08:10:42 GMT target: https://www.storj.io/ FAIL (2025-08-29 08:10:43 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 371.457809ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 646.584841ms remote: "tcp:13.233.175.166:443" response headers: Set-Cookie=_cfuvid=KE2SVfMCeDUpw1kIm2mWp9UHJEt5aG31c_o4jaKs_r0-1756455031699-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:10:31 GMT Content-Type=text/html Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Ray=976a9289bb8d7766-BOM Cf-Cache-Status=BYPASS Alt-Svc=h3=":443"; ma=86400 Cache-Control=private Vary=Accept-Encoding target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:10:31 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 646.609348ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [........XX.......XXXXXXXXXXXXXXXXXXXXXXX....................] duration: 6.123288903s FAIL (2025-08-29 08:10:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 6.123321605s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [.XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX...................] duration: 6.153882793s FAIL (2025-08-29 08:10:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.153915686s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [....XX........XXXXXXXXXXXXXXXXXXXXXXXX......................] duration: 5.844412817s FAIL (2025-08-29 08:10:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.844507248s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 484.997612ms remote: "tcp:13.203.125.58:443" response headers: Surrogate-Control=max-age=2147483647 Set-Cookie=_cfuvid=xuLCEhHtk5skyP_sPwek.C7l_3k8iuPP6YqpXO1r_Lk-1756454995706-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Date=Fri, 29 Aug 2025 08:09:55 GMT Content-Type=text/html Cf-Ray=976a91aa29093ba3-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Vary=Accept-Encoding Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Age=219834 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e target: https://www.storj.io/ FAIL (2025-08-29 08:09:55 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 485.020556ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [.....XX........XXXXXXXXXXXXXXXXXXXXXXXX.....................] duration: 5.656066444s FAIL (2025-08-29 08:09:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.656089078s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 854.450182ms remote: "tcp:13.203.125.58:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Vary=Accept-Encoding Set-Cookie=_cfuvid=ETL9zvPxxcsA6a1LNsk3I1CCDrpX6AR1RZFEKGQGlQk-1756454986252-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 08:09:46 GMT Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Ray=976a916dc81c47eb-BOM Cf-Cache-Status=BYPASS Cache-Control=private target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:09:46 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 854.46936ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [.........XX.......XXXXXXXXXXXXXXXXXXXXXXX...................] duration: 5.867052194s FAIL (2025-08-29 08:09:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.867082902s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 675.638264ms remote: "tcp:13.203.125.58:443" response headers: Content-Length=166 Cf-Ray=976a90f93aa0ffa7-BOM Set-Cookie=_cfuvid=3S8Ft8_gknzhFjiehCcXeMEjJb56wuKgEURHhB3M_y0-1756454967650-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Date=Fri, 29 Aug 2025 08:09:27 GMT Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:09:27 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 675.656168ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [......XX........XXXXXXXXXXXXXXXXXXXXXXXX....................] duration: 5.902041484s FAIL (2025-08-29 08:09:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.902068878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [..XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX..................] duration: 6.236376482s FAIL (2025-08-29 08:09:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.236408042s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [.......XX........XXXXXXXXXXXXXXXXXXXXXXXX...................] duration: 5.861786941s FAIL (2025-08-29 08:09:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.861820164s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 370.341171ms remote: "tcp:3.109.243.18:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:08:43 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Content-Type=text/html Age=219808 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Set-Cookie=_cfuvid=zE83THI2s0B_5WItl3ayhobEAV_ZLdKH6NQDnEksapc-1756454923057-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Ray=976a8fe4cf0285fd-BOM Surrogate-Control=max-age=2147483647 Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT target: https://www.storj.io/ FAIL (2025-08-29 08:08:43 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 370.364306ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 666.132424ms remote: "tcp:3.109.243.18:443" response headers: Location=https://static.storj.io/dcs-satellites Cf-Ray=976a8f88fba33d54-BOM Cf-Cache-Status=BYPASS Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:08:28 GMT Content-Length=166 Cache-Control=private Set-Cookie=_cfuvid=UVVxW7ccSHABm2VMtxWEHZpQeoCqA9Qn9N9ZSWDEOtk-1756454908704-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:08:28 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 666.169214ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [..........XX.......XXXXXXXXXXXXXXXXXXXXXXX..................] duration: 6.03808558s FAIL (2025-08-29 08:08:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 6.038099547s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [...XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.................] duration: 6.19780658s FAIL (2025-08-29 08:08:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.197836326s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [........XX........XXXXXXXXXXXXXXXXXXXXXXXX..................] duration: 5.937337993s FAIL (2025-08-29 08:08:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.937366397s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 390.370406ms remote: "tcp:3.109.243.18:443" response headers: Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 Date=Fri, 29 Aug 2025 08:08:00 GMT Cf-Ray=976a8ed91efc46b4-BOM X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Set-Cookie=_cfuvid=NjxpHvI.5rUY_FsomB57h4JpvJlMfauLsuvY2gA1c_Y-1756454880253-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Age=219133 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/ FAIL (2025-08-29 08:08:00 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 390.394984ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [.........XX........XXXXXXXXXXXXXXXXXXXXXXXX.................] duration: 5.920336712s FAIL (2025-08-29 08:07:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.920365588s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [...........XX.......XXXXXXXXXXXXXXXXXXXXXXX.................] duration: 5.913029008s FAIL (2025-08-29 08:07:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.913068994s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [....XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX................] duration: 6.049646232s FAIL (2025-08-29 08:07:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.049674106s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 650.342794ms remote: "tcp:3.109.243.18:443" response headers: Content-Length=166 Cf-Ray=976a8dc85bda3b45-BOM Cf-Cache-Status=BYPASS Set-Cookie=_cfuvid=1aKpZsnaxY1lYhrfs7m569Y_Jf6y4WFlZb5F6N1jECU-1756454836915-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Location=https://static.storj.io/dcs-satellites Cache-Control=private Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:07:16 GMT Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:07:16 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 650.364785ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [..........XX........XXXXXXXXXXXXXXXXXXXXXXXX................] duration: 5.981059954s FAIL (2025-08-29 08:07:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.98108865s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [............XX.......XXXXXXXXXXXXXXXXXXXXXXX................] duration: 5.951714728s FAIL (2025-08-29 08:06:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.951739737s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 367.354147ms remote: "tcp:13.233.175.166:443" response headers: Content-Type=text/html Cf-Cache-Status=HIT Age=219264 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding Set-Cookie=_cfuvid=2aF9gM5.vQgwXQCn7fZWiZ4nOWtexE4ddqYcXAY5ZJk-1756454809243-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Cf-Ray=976a8d1d8a173fe4-BOM Surrogate-Control=max-age=2147483647 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:06:49 GMT target: https://www.storj.io/ FAIL (2025-08-29 08:06:49 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 367.3825ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 344.174153ms remote: "tcp:3.109.243.18:443" response headers: Date=Fri, 29 Aug 2025 08:06:23 GMT Set-Cookie=_cfuvid=vSh17zwTIwfH5fSDvP_gmLly8kRBCIPIia5_01if8Ww-1756454783299-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Content-Type=text/html X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Cf-Ray=976a8c7b6a5a002c-BOM Surrogate-Control=max-age=2147483647 Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT Age=219238 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/ FAIL (2025-08-29 08:06:23 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 344.194771ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [.....XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX...............] duration: 6.03922952s FAIL (2025-08-29 08:06:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.039251853s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 613.419661ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 08:06:22 GMT Content-Type=text/html Content-Length=166 Cf-Ray=976a8c712f703d26-BOM Cf-Cache-Status=BYPASS Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Location=https://static.storj.io/dcs-satellites Cache-Control=private Set-Cookie=_cfuvid=gEWEinVRCWHHe3MAanXnYOt83y6oKWEtrtealZlw2xQ-1756454781983-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:06:22 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 613.443829ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [...........XX........XXXXXXXXXXXXXXXXXXXXXXXX...............] duration: 5.830835906s FAIL (2025-08-29 08:06:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.83087995s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [.............XX.......XXXXXXXXXXXXXXXXXXXXXXX...............] duration: 5.951029209s FAIL (2025-08-29 08:05:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.951057213s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 865.313788ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 08:05:55 GMT Content-Type=text/html Content-Length=166 Cf-Ray=976a8bcc4d0d71b6-BOM Cf-Cache-Status=BYPASS Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Location=https://static.storj.io/dcs-satellites Cache-Control=private Set-Cookie=_cfuvid=Bjo6j6kd2zc8L2mHHYorXEtwdpwL3.iS27aZgQEHp10-1756454755631-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:05:55 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 865.360848ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [......XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX..............] duration: 6.281122095s FAIL (2025-08-29 08:05:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.281152544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [............XX........XXXXXXXXXXXXXXXXXXXXXXXX..............] duration: 6.174517678s FAIL (2025-08-29 08:05:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 6.174540802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [..............XX.......XXXXXXXXXXXXXXXXXXXXXXX..............] duration: 6.290904831s FAIL (2025-08-29 08:05:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 6.29093513s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 398.55676ms remote: "tcp:13.233.175.166:443" response headers: Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=nFJMwqbCFNeZzEn0Br8LWjESyGgvR8kFzDHn2o9E1B8-1756454711756-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Surrogate-Control=max-age=2147483647 Date=Fri, 29 Aug 2025 08:05:11 GMT Cf-Ray=976a8abc0ef347ca-BOM Vary=Accept-Encoding Content-Type=text/html Cf-Cache-Status=HIT Age=218964 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT target: https://www.storj.io/ FAIL (2025-08-29 08:05:11 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 398.585617ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [.......XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.............] duration: 6.105499787s FAIL (2025-08-29 08:05:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.105536137s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 668.688647ms remote: "tcp:13.233.175.166:443" response headers: Content-Length=166 Cf-Ray=976a8a37bd31ff6c-BOM Cf-Cache-Status=BYPASS Vary=Accept-Encoding Content-Type=text/html Location=https://static.storj.io/dcs-satellites Cache-Control=private Set-Cookie=_cfuvid=kWYLry6.Obz3WgdZXspfbwYvEcivh2zvs45eIHQf5H4-1756454690883-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:04:50 GMT target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 08:04:50 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 668.743532ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [...............XX.......XXXXXXXXXXXXXXXXXXXXXXX.............] duration: 5.985534596s FAIL (2025-08-29 08:04:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.985561738s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [........XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX............] duration: 6.207051708s FAIL (2025-08-29 08:04:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 6.207080545s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 379.759371ms remote: "tcp:13.203.125.58:443" response headers: Age=219122 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 08:04:27 GMT Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Set-Cookie=_cfuvid=4B.lam1KsGzDtQ8RIK_GWqi3YN3LPlbJGdxbxMqhLqk-1756454667087-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Ray=976a89a50d8c3deb-BOM Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html target: https://www.storj.io/ FAIL (2025-08-29 08:04:27 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 379.783418ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [................XX.......XXXXXXXXXXXXXXXXXXXXXXX............] duration: 6.207507162s FAIL (2025-08-29 08:04:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 6.207532181s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)