Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [........................XX.......XXXXXXXXXXXXXXXXXXXXXXX....] duration: 5.926455172s FAIL (2025-08-29 07:56:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.926483326s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [.......................XX........XXXXXXXXXXXXXXXXXXXXXXXX...] duration: 5.71480512s FAIL (2025-08-29 07:56:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.714824476s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [.........................XX.......XXXXXXXXXXXXXXXXXXXXXXX...] duration: 5.754853591s FAIL (2025-08-29 07:56:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.754934925s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 631.774904ms remote: "tcp:13.203.125.58:443" response headers: Cache-Control=private Set-Cookie=_cfuvid=dZyD570l.Rww_3rCofX5aJpG29LqYcYovm884FU_GT8-1756454193958-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Location=https://static.storj.io/dcs-satellites Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:56:33 GMT Content-Type=text/html Content-Length=166 Cf-Ray=976a7e15ecc6441b-BOM Cf-Cache-Status=BYPASS target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:56:34 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 631.826573ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [..................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 5.860899676s FAIL (2025-08-29 07:56:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 5.860918963s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [........................XX........XXXXXXXXXXXXXXXXXXXXXXXX..] duration: 5.835610035s FAIL (2025-08-29 07:56:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.83563462s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 631.181448ms remote: "tcp:13.233.175.166:443" response headers: Cf-Ray=976a7db79d98cb4f-BOM Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:56:18 GMT Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private Set-Cookie=_cfuvid=Y61VhXLByqY8xn5StOoh0A2SxPMS.b4jv10cMBf2UyU-1756454178869-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:56:18 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 631.206697ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 625.228223ms remote: "tcp:13.233.175.166:443" response headers: Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976a7d956a163ab3-BOM Surrogate-Control=max-age=2147483647 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Date=Fri, 29 Aug 2025 07:56:13 GMT Content-Type=text/html Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding Set-Cookie=_cfuvid=4vhy0lBAkKlrlQHaw7DCUW_RPDdlKGsy3H7pRkyt_3Q-1756454173090-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Age=219012 target: https://www.storj.io/ FAIL (2025-08-29 07:56:13 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 625.254754ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [..........................XX.......XXXXXXXXXXXXXXXXXXXXXXX..] duration: 5.845548572s FAIL (2025-08-29 07:56:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 5.84561102s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [...................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 5.870567724s FAIL (2025-08-29 07:56:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 5.870598962s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [.........................XX........XXXXXXXXXXXXXXXXXXXXXXXX.] duration: 5.745975095s FAIL (2025-08-29 07:55:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 5.746000684s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [...........................XX.......XXXXXXXXXXXXXXXXXXXXXXX.] duration: 36.431642228s FAIL (2025-08-29 07:55:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 36.431659543s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 26 out of 60 is failed (threshold=3) [..........................XX........XXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.001585945s FAIL (2025-08-29 07:55:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 29 07:54:37.804369049 (15h1m51.796404472s) [upload=15524]: Starting upload Aug 29 07:54:37.804430917 (15h1m51.79646633s) [upload=15524]: Done starting upload Aug 29 07:54:37.804527331 (15h1m51.796562744s) [upload=15524]: Uploading segments... Aug 29 07:54:37.804639396 (15h1m51.796674819s) [upload=15524]: Got next segment. Inline: false Aug 29 07:54:37.804666698 (15h1m51.796702121s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:54:37.804671077 (15h1m51.7967065s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:54:38.321431861 (15h1m52.313467335s) [seg_pos={0 0}, upload=15524]: Begin upload segment... Aug 29 07:54:38.321508518 (15h1m52.313543981s) [seg_pos={0 0}, upload=15524]: Done begin upload segment. Aug 29 07:54:38.321546410 (15h1m52.313581833s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.321564936 (15h1m52.313600399s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322063961 (15h1m52.314099384s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.322607651 (15h1m52.314643074s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323022785 (15h1m52.315058209s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323337418 (15h1m52.315372841s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323519757 (15h1m52.31555518s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.323829710 (15h1m52.315865133s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324073186 (15h1m52.316108609s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324296704 (15h1m52.316332127s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324476698 (15h1m52.316512121s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324703743 (15h1m52.316739166s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.324928262 (15h1m52.316963685s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325176868 (15h1m52.317212291s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325467153 (15h1m52.317502576s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.325732742 (15h1m52.317768165s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326041973 (15h1m52.318077396s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:38.326293404 (15h1m52.318328827s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Uploading piece... Aug 29 07:54:39.451716434 (15h1m53.443751847s) [upload=15524]: Next returned nil segment Aug 29 07:54:39.451731854 (15h1m53.443767277s) [upload=15524]: Waiting for error group managing segments... Aug 29 07:54:39.736528017 (15h1m53.72856344s) [noise=true , address=79.127.205.246:4279 , piece_id=2DHS2U6PZ77G3IG3A6JSSTG6WJLAGJAEMVY3Q6FSW5WG2QWDBX4A, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.762784076 (15h1m53.754819499s) [noise=true , address=79.127.205.245:4250 , piece_id=ARUPNDKK26W3IFSONXZWK54MRKIR2PVDMYZY76YSPD37IG2PKVVA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:39.964243288 (15h1m53.956278711s) [noise=true , address=64.49.13.138:4482 , piece_id=3R3AVMQOF2WAXP7TIF7H62SEFIPMLOBOJYUVVOC5SSVQEND7DCNA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.294925983 (15h1m54.286961406s) [noise=true , address=156.146.43.225:4448 , piece_id=VERLGPOM4FGVELPVPKF76NPKHVY7QQEOZVYEILRYXXQY4KOK2FJA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.296003235 (15h1m54.288038648s) [noise=true , address=45.91.116.12:4254 , piece_id=BWYAL672OIELAPWTAHNPKESFJDBPOCYVY6XI5GT63DIR4WZGHQCA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.303953326 (15h1m54.29598875s) [noise=true , address=104.36.82.48:4586 , piece_id=YHVXM7ZPZEU26FAXBHUAUZKQPHBB3GCNDWMFSOST4FRXU67GBQHQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:40.458137681 (15h1m54.450173104s) [noise=true , address=77.90.31.17:4797 , piece_id=PYW6APS65VF5C3KVUMPMB4RM62W2XA7AHIC5RQMPX5Z7D5WTZMSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:44.243820565 (15h1m58.235856028s) [noise=true , address=104.36.82.9:4039 , piece_id=GKUPNGTFEY7ZZBJ6MIH2PQMDR6QZXQSJBKWFI775VCVBFLLKJ27Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:54:57.774154861 (15h2m11.766190284s) [noise=true , address=77.90.31.15:4708 , piece_id=5E65FP46GCYT752XQI5QJSIXVO42ICG23VRSSMJDIWQMLQLMK5GA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:27.377824018 (15h2m41.369859441s) [noise=true , address=104.36.82.48:4578 , piece_id=LOJ3R7B5BFLOWMTHV74OACD6JTT7QTI5FYLH76QLMHLXXRBXTIDQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.190114861 (15h2m45.182150274s) [noise=true , address=45.91.116.11:4130 , piece_id=MIFMIMZFY5FKBPPJ5YZDM6Q5ZFILDVQ2XSZ4LN7HIKPTEWFW66BA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.272913351 (15h2m45.264948774s) [noise=true , address=45.91.116.4:4970 , piece_id=FL27FRUFI43VUN4IG5GHR6JBMMJN2D2B4ZF4ZOLZZ7EEIVVUN5FA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:31.556196609 (15h2m45.548232032s) [noise=true , address=77.90.31.11:4566 , piece_id=VGI73D7ETEKJDAYHYITJ7E2RPMCNM4DQBEKM56XPCDMQ6PAYTSZA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286554228 (15h2m49.278589651s) [noise=true , address=77.90.31.10:4541 , piece_id=EEX244GQRFWHPVWQKPNXFXHP7ZFKCOKRP7SUXDZB7F6IM5HS2SSQ, seg_pos={0 0}, upload=15524]: Done uploading piece. err: <nil> Aug 29 07:55:35.286582863 (15h2m49.278618286s) [seg_pos={0 0}, upload=15524]: Segment reached optimal threshold of 14 pieces. Aug 29 07:55:35.286821700 (15h2m49.278857133s) [noise=true , address=45.91.116.8:4061 , piece_id=JO4UAZPPTR3LEWGDAXHYBCIMUGQHYCV3TGFNUY6WJH7YJR2CC57Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PNUjUx8cyVPuyuYJcXzXZRsidGqCCcVWFqNkiwXq4EQ8j5HBL): protocol: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47212->45.91.116.8:4061: use of closed network connection Aug 29 07:55:35.286861165 (15h2m49.278896588s) [noise=true , address=77.90.31.18:4823 , piece_id=ERCF63SIQOWQX76VK2IHYXGXN5U43JTLHR5YG2XYV4ZLLS6S5FBA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50408->77.90.31.18:4823: use of closed network connection Aug 29 07:55:35.286898828 (15h2m49.278934261s) [noise=true , address=104.36.82.23:4457 , piece_id=FP26ZRTJICUYTDBFX53QBIBOIQVESK272ULUPMUNT7GNTWREH3QA, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45344->104.36.82.23:4457: use of closed network connection Aug 29 07:55:35.286924487 (15h2m49.27895991s) [noise=true , address=77.90.31.13:4634 , piece_id=7WHQJ2UO2FEPEHP4MWJIPVGGJMEF4PBE7JMCG4BUXD3A4EA2OD3Q, seg_pos={0 0}, upload=15524]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7): protocol: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41728->77.90.31.13:4634: use of closed network connection Aug 29 07:55:35.286952821 (15h2m49.278988244s) [seg_pos={0 0}, upload=15524]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 29 07:55:35.287036521 (15h2m49.279071954s) [upload=15524]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 29 07:55:35.287041130 (15h2m49.279076573s) [upload=15524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 29 07:55:35.679099994 (15h2m49.671135417s) [upload=15524]: Done uploading segments... Aug 29 07:55:35.679117308 (15h2m49.671152741s) [upload=15524]: Upload finished. err: <nil> Duration: 1m0.00160384s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 33 out of 60 is failed (threshold=3) [....................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.260259808s FAIL (2025-08-29 07:55:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== m11.278630774s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286603617 (15h2m11.27863903s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286967994 (15h2m11.279003417s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.286993493 (15h2m11.279028916s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287236889 (15h2m11.279272312s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287305841 (15h2m11.279341264s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287496526 (15h2m11.279531949s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287624139 (15h2m11.279659562s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287739981 (15h2m11.279775404s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287928772 (15h2m11.279964195s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.287954792 (15h2m11.279990215s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288175574 (15h2m11.280210997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288182939 (15h2m11.280218362s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288388312 (15h2m11.280423725s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288608964 (15h2m11.280644387s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:57.288823495 (15h2m11.280858918s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Uploading piece... Aug 29 07:54:59.114133450 (15h2m13.106168883s) [upload=15529]: Next returned nil segment Aug 29 07:54:59.114152246 (15h2m13.106187669s) [upload=15529]: Waiting for error group managing segments... Aug 29 07:54:59.401328713 (15h2m13.393364136s) [noise=true , address=45.91.116.9:4263 , piece_id=7FMAODQA5XYH4PBT6WZBYLNVIYSA7JQFWNQSNF3MAYYMNFEYER4A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.482508226 (15h2m13.47454364s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD5U6AYS4CNVAXOZ3MZF3KTGW55HI3XFCTSYKRQMZPCP5FYS27XA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:54:59.651947510 (15h2m13.643982933s) [noise=true , address=104.36.82.13:4187 , piece_id=WTLVC4SYTIVM4FCWN5BAHNSBTY7KCGXPZ565I6UP4EM2FGJH6ZEA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:01.624662540 (15h2m15.616697963s) [noise=true , address=45.91.116.5:4298 , piece_id=ITRJTWYWLFWYODI2POOMGB2CAVUZV6NGHUFSXEHRQP5IJEQYJB2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:02.590230546 (15h2m16.582265969s) [noise=true , address=104.36.82.6:4875 , piece_id=UF4LJIVADJVUZYYTSGFEP77P2JYWBQ2TCFSP5KZB4CQHSVQ6CLJA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:03.353117131 (15h2m17.345152555s) [noise=true , address=45.91.116.10:4081 , piece_id=TBRYKS34MFTSPO6HAUB45HXVJDGZRJZZEYDM4ACTUBZWLR4OFZCA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:06.820879015 (15h2m20.812914448s) [noise=true , address=104.36.82.5:4840 , piece_id=RCQZGJYNUNRBBATRKKHATN3I2LYCKTY7H2R277HQOUASJ2XFVYYA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:25.935539169 (15h2m39.927574602s) [noise=true , address=77.90.31.10:4520 , piece_id=QUDKICBGNF6QMDNB44HP7NJLE5HXLGLWCNU4QIEBHILT6YT3EVZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil> Aug 29 07:55:26.030647925 (15h2m40.022683348s) [noise=true , address=45.91.116.11:4119 , piece_id=3ORJ5PK3BJJ7OEH3FJHLMRJTWVFFVTTAN3CANE7FGYPOTKPQ4JSQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.030741574 (15h2m40.022776997s) [noise=true , address=104.36.82.11:4113 , piece_id=IAFYIQDZF7QBU3VN2KJA6R7VKCMEMQ57VBDPFVWUQQDH5HSHMP3A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34318->104.36.82.11:4113: use of closed network connection Aug 29 07:55:26.030830955 (15h2m40.022866379s) [noise=true , address=45.91.116.11:4117 , piece_id=TARP5JSVSRSGWE6YVVJDBRUBBH777VZ4UPKQAX3WGDQV6CAKRPBA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33602->45.91.116.11:4117: use of closed network connection Aug 29 07:55:26.030938401 (15h2m40.022973824s) [noise=true , address=45.91.116.14:4189 , piece_id=2JAPCXL4DI5QAKFGRN6UGJ2L3CCXNQ7P3R6Z6DT6457EQRT4HJGA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56096->45.91.116.14:4189: use of closed network connection Aug 29 07:55:26.030977055 (15h2m40.023012478s) [noise=true , address=45.91.116.13:4153 , piece_id=MAT6XIQVJS4EGSH5FWZ47WEYO3WRH2UIC475LLB5GOF7ZTWUYKUQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37912->45.91.116.13:4153: use of closed network connection Aug 29 07:55:26.030997314 (15h2m40.023032737s) [noise=true , address=77.90.31.13:4628 , piece_id=WNX2GHARGKZZSOS7C5AJRSBAQDYGTOTKCZVDFLE3N5UVMMVWHKAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031015207 (15h2m40.02305063s) [noise=true , address=104.36.82.2:4732 , piece_id=YFA7AC444BPQUGDHOS2EULRNLB2TYHACTKJ36WS3YDRKRVH4TY7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34482->104.36.82.2:4732: use of closed network connection Aug 29 07:55:26.031037761 (15h2m40.023073184s) [noise=true , address=77.90.31.17:4772 , piece_id=LLD3RF75JGNKXJDDFMW5VVK7KUZAJQOBVUD5W26WEOFVWDQ2RINQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: read tcp 188.166.225.170:38296->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:26.031058320 (15h2m40.023093743s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Aug 29 07:55:26.289729093 (15h2m40.281764516s) [upload=15529]: Done uploading segments... Aug 29 07:55:26.289792003 (15h2m40.281827437s) [upload=15529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 30.260285168s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 622.663835ms remote: "tcp:3.109.243.18:443" response headers: Content-Type=text/html Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976a7c22e87b46f0-BOM Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=h6gaMFhlWbLRvOxNT4dcuIk4A3tiloltSTdXEkSQTN4-1756454114109-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Date=Fri, 29 Aug 2025 07:55:14 GMT target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:55:14 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 622.68735ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [............................XX.......XXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.255840551s FAIL (2025-08-29 07:55:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415175762 (15h1m19.407211185s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415199547 (15h1m19.40723497s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415472789 (15h1m19.407508213s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415591788 (15h1m19.407627211s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415743167 (15h1m19.4077786s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415914876 (15h1m19.407950299s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.415996793 (15h1m19.408032216s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416140989 (15h1m19.408176412s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416273202 (15h1m19.408308625s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416508341 (15h1m19.408543764s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416716540 (15h1m19.408751963s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.416964244 (15h1m19.408999667s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417185176 (15h1m19.4092206s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417569241 (15h1m19.409604664s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.417886007 (15h1m19.40992144s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:05.418117550 (15h1m19.410152974s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Uploading piece... Aug 29 07:54:06.577446247 (15h1m20.56948167s) [upload=15514]: Next returned nil segment Aug 29 07:54:06.577462398 (15h1m20.569497821s) [upload=15514]: Waiting for error group managing segments... Aug 29 07:54:06.871021158 (15h1m20.863056581s) [noise=true , address=79.127.205.245:4245 , piece_id=PJ7ZLGNDRTTR2HEM5U2BSQUUKC7TSOYCOSUEL35UISO2XAPEZYAA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:06.880536877 (15h1m20.8725723s) [noise=true , address=79.127.205.246:4283 , piece_id=P7VIBNAGRJCYEIPCFNFRYE4U2BS4ANNUGMSRCWOJT3OPDPDCKMJA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.288252930 (15h1m21.280288353s) [noise=true , address=79.127.219.47:4050 , piece_id=FEQVERNHLKO7ETHG7PF5WOPKIYTYLPQ2KP35ZAM3GZZCFILJKN6Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.398382117 (15h1m21.39041754s) [noise=true , address=156.146.43.225:4448 , piece_id=PPT5I26FNK4M5YR4BOR4F6M6S7OXWO5IGNUZF3TVGPNEUE2GI6ZA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411511890 (15h1m21.403547313s) [noise=true , address=77.90.31.14:4685 , piece_id=KRNDXMMRATOYKYK6AVAVK6XWOREQEJOUM7UQBLXP27COBPESTFKA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.411702936 (15h1m21.403738359s) [noise=true , address=45.91.116.5:4321 , piece_id=LHYFAU6PGB3IKCLGGXJGJXGR3SG6JFJKYB7IEEP4TMZTGVECRGSA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.519054026 (15h1m21.511089449s) [noise=true , address=104.36.82.23:4447 , piece_id=SNYMJRYN76STPGVF2RGOK3UAHEL7OYJL5PLAB3G2P6WACQQHZU7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:07.531202722 (15h1m21.523238145s) [noise=true , address=45.91.116.10:4096 , piece_id=FW5JM3PENYGGJVMOIXMV2PECRK7PTOUM74QEDRUARGEBYL2HDCQQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:08.652241313 (15h1m22.644276736s) [noise=true , address=77.90.31.21:4885 , piece_id=TEHAFHHXSYEZOZH5ORSXIYBJMQB3W2O2H2TEPVSZVBNMCQUODU5Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:10.615327583 (15h1m24.607362996s) [noise=true , address=77.90.31.18:4815 , piece_id=TUSKJAKUNKQCAYTV5MTUKNIXXS64FMR346ZHUE5ITTIH5MS64OEQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:13.054967321 (15h1m27.047002744s) [noise=true , address=64.49.13.26:4954 , piece_id=6A5ZMFLMFX4KB34V2M7SMKOPCBQMLE3NME4Y4INBSLWMZYC4KTWQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:54:20.120905925 (15h1m34.112941348s) [noise=true , address=77.90.31.15:4716 , piece_id=VUSCPQRLH7LKFZUY2HZKYH7MCRRQWNTTMFUHELWZE5PXDGJPMVEA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: <nil> Aug 29 07:55:04.152873753 (15h2m18.144909177s) [noise=true , address=64.49.13.138:4483 , piece_id=WCQGYQLCFVFF4EVBTR6GO4UOIEWK33CAH7754YB3IFARAO22AQDQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60234->64.49.13.138:4483: use of closed network connection Aug 29 07:55:04.152965919 (15h2m18.145001343s) [noise=true , address=45.91.116.14:4220 , piece_id=ZECLY2U2RLCYSTT3QP7DQIYATIZCXDA3BWFNNRP2HANTXHGAX5KA, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12ZH3hS6xJp29U2RWAN9p8kxNdkSUQr1E58HzcFei48fUbNzFvW, address:45.91.116.14:4220): protocol: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51242->45.91.116.14:4220: use of closed network connection Aug 29 07:55:04.152979807 (15h2m18.14501523s) [noise=true , address=45.91.116.6:4008 , piece_id=5YBRYUEEDSNE3FCZ7VY3QHRDM7UKFUCQ6Z3C5IXTU6LS4KAW2D6A, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38154->45.91.116.6:4008: use of closed network connection Aug 29 07:55:04.153028340 (15h2m18.145063773s) [noise=true , address=104.36.82.48:4577 , piece_id=7WR4HNVHFXV6SCHITCB4LY3OVT2K7OK76WWHTW6PUABBA4OIN6LQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12BiDVmGW3SkqH6gMGoJj2cT2SbR3DbMVTPSWQgHcx4scb6cN5q, address:104.36.82.48:4577): protocol: write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection; write tcp 188.166.225.170:40152->104.36.82.48:4577: use of closed network connection Aug 29 07:55:04.153053688 (15h2m18.145089111s) [noise=true , address=77.90.31.16:4739 , piece_id=6K3HDEWQEEDVTNU5EJ2BCNN4BOEDJE2HE43IQG7F3KUMTMKRJSOQ, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35306->77.90.31.16:4739: use of closed network connection Aug 29 07:55:04.153212622 (15h2m18.145248045s) [noise=true , address=77.90.31.12:4616 , piece_id=PAWEEAJX2MW7EVGO4QSCEGFDW6AXCVTILVS5QSPOVUPIQYZXWM7Q, seg_pos={0 0}, upload=15514]: Done uploading piece. err: ecclient: upload failed (node:12Qb6sMhCyzYd4S15Td1kzD7kgqNKSi2avG15CQRSG8bcDVvGzi, address:77.90.31.12:4616): protocol: read tcp 188.166.225.170:35750->77.90.31.12:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:55:04.153341889 (15h2m18.145377312s) [seg_pos={0 0}, upload=15514]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 29 07:55:04.406468995 (15h2m18.398504428s) [upload=15514]: Done uploading segments... Aug 29 07:55:04.406501227 (15h2m18.39853665s) [upload=15514]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.255857605s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 375.884537ms remote: "tcp:13.233.175.166:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Date=Fri, 29 Aug 2025 07:55:02 GMT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 Set-Cookie=_cfuvid=aKuqI79TrL2jKT7e.1wB62CiJy.xPmwI4.R6ixKf8XY-1756454102239-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Cache-Status=HIT Alt-Svc=h3=":443"; ma=86400 Cf-Ray=976a7bdaacd6a6ad-BOM Age=218866 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding target: https://www.storj.io/ FAIL (2025-08-29 07:55:02 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 375.91693ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 506.459243ms remote: "tcp:13.203.125.58:443" response headers: Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976a7b5a088947d7-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Set-Cookie=_cfuvid=.93FLBT89p44xUmlPVLmuCioNdupbMOo3kN6EMYqMlw-1756454081792-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Age=218334 Date=Fri, 29 Aug 2025 07:54:41 GMT Cf-Cache-Status=HIT Surrogate-Control=max-age=2147483647 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Content-Type=text/html target: https://www.storj.io/ FAIL (2025-08-29 07:54:41 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 506.484593ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 25 out of 60 is failed (threshold=3) [...........................XX........XXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.248546867s FAIL (2025-08-29 07:54:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== Aug 29 07:53:37.242576783 (15h0m51.234612207s) [upload=15505]: Starting upload Aug 29 07:53:37.242632420 (15h0m51.234667853s) [upload=15505]: Done starting upload Aug 29 07:53:37.242751517 (15h0m51.23478694s) [upload=15505]: Uploading segments... Aug 29 07:53:37.242905132 (15h0m51.234940545s) [upload=15505]: Got next segment. Inline: false Aug 29 07:53:37.242939748 (15h0m51.234975171s) [upload=15505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:53:37.242944447 (15h0m51.23497987s) [upload=15505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:53:37.728029592 (15h0m51.720065025s) [seg_pos={0 0}, upload=15505]: Begin upload segment... Aug 29 07:53:37.728086942 (15h0m51.720122365s) [seg_pos={0 0}, upload=15505]: Done begin upload segment. Aug 29 07:53:37.728110627 (15h0m51.72014605s) [noise=true , address=104.36.82.4:4812 , piece_id=H2CWMBUX23NXQBRJECLHY44NYHMISBWEQ3VETQPBKSZAKIUD3PTA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.728147066 (15h0m51.720182489s) [noise=true , address=77.90.31.16:4757 , piece_id=YHJFXQXSHQEUDZHI4FRWNKGAHIPMXY2AA6NTJDFPPM2DLTWEBQLQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.728461869 (15h0m51.720497292s) [noise=true , address=45.91.116.6:4992 , piece_id=QZ56OEIQJKBF7VPWQTWGOUCTQDDFOVFVYKRHDY25HSCE4EFMU5CQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.728659207 (15h0m51.72069464s) [noise=true , address=79.127.219.51:4212 , piece_id=ENAQR6CTSOPTDKNKB4KLJXEBNQNSGRV4LVHNDBGVBKUNUVIHIBLQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.728777352 (15h0m51.720812775s) [noise=true , address=45.91.116.14:4206 , piece_id=VGCENMRZ2CHRM6CTEHUHUWBCKCVBBT54IR77GRTNKTKZP3224XHA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.729016951 (15h0m51.721052374s) [noise=true , address=77.90.31.12:4615 , piece_id=NMJOHPWMRKORZZUM4PTR6LNZLZMQOQNQCMWNXO6KWPZYCWKUGGLQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.729330681 (15h0m51.721366104s) [noise=true , address=77.90.31.18:4827 , piece_id=WQBN3ZFG5UG4HNGEMNDHEYVQUE3MVVEPLODTYV4IFPPWCU3BHSZA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.729630014 (15h0m51.721665447s) [noise=true , address=77.90.31.14:4689 , piece_id=ADUSVK26QIZ2H7BCXLC6MUNEZC2VL5RPDOD3AKVZ26RST7CRKKHQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.729960476 (15h0m51.721995899s) [noise=true , address=79.127.205.246:4280 , piece_id=XIF56FUGQ7HPVY7W6K2VQQ7C53POZW6WLZM5T5IFX2ORFVOSEB3Q, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.730210255 (15h0m51.722245678s) [noise=true , address=45.91.116.4:4945 , piece_id=A7PT4CV2DRRZ65GYJIRJPVWTEGPIVGQ4AR4AZGR6G2LP4FB663BA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.730388225 (15h0m51.722423648s) [noise=true , address=79.127.205.245:4238 , piece_id=SOYV4X6ZJ6ZKAFCZYDOTN7ZD6P4TFZ3G7F7LYPO3QYBVFITRCXPQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.730665575 (15h0m51.722700999s) [noise=true , address=104.36.82.48:4576 , piece_id=HBDKDIYCFS65VTUBKKYMHUA7HBQOG5H4LFJNMPS52FYV64EQCKZQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.730881579 (15h0m51.722917002s) [noise=true , address=77.90.31.10:4531 , piece_id=QBUS2SKMW7ICD3AE5RQPAKX4VPGW7VDT4L3FEUMHHM4DTNXNQSGQ, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.731142248 (15h0m51.723177671s) [noise=true , address=104.36.82.60:4369 , piece_id=XTI7DGTFBRV5EVGZ2Y7YZS667SXY3HQ4KBNT4IHE6T63ITRM72WA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.731398578 (15h0m51.723434001s) [noise=true , address=104.36.82.23:4455 , piece_id=JMWZFLN3LYXUDAWTS5Y6CB5TJ6XXTSSUZRFUJRZQLR6G6VGEQFTA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.731674296 (15h0m51.723709719s) [noise=true , address=77.90.31.11:4581 , piece_id=5DD4Q5AOAQCOEOQQVPSFBRL7AB5KM4XGLSV6PEE3MT4EYNGK26CA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.731940195 (15h0m51.723975618s) [noise=true , address=104.36.82.53:4122 , piece_id=K6ATTT6O5JTL464P7ZNYARAQZYEVFDIWI62ZHJHRF7IXC6OPVE4A, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:37.732196635 (15h0m51.724232058s) [noise=true , address=77.90.31.17:4804 , piece_id=NIMVZJCC5SPO6BQZX34UFZ5KSNA2PMY6BKFLM4XXUM5ZK4YWE4OA, seg_pos={0 0}, upload=15505]: Uploading piece... Aug 29 07:53:38.853809103 (15h0m52.845844516s) [upload=15505]: Next returned nil segment Aug 29 07:53:38.853831296 (15h0m52.845866719s) [upload=15505]: Waiting for error group managing segments... Aug 29 07:53:39.136448149 (15h0m53.128483572s) [noise=true , address=79.127.205.246:4280 , piece_id=XIF56FUGQ7HPVY7W6K2VQQ7C53POZW6WLZM5T5IFX2ORFVOSEB3Q, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:53:39.209826615 (15h0m53.201862038s) [noise=true , address=79.127.205.245:4238 , piece_id=SOYV4X6ZJ6ZKAFCZYDOTN7ZD6P4TFZ3G7F7LYPO3QYBVFITRCXPQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:53:39.638146003 (15h0m53.630181426s) [noise=true , address=79.127.219.51:4212 , piece_id=ENAQR6CTSOPTDKNKB4KLJXEBNQNSGRV4LVHNDBGVBKUNUVIHIBLQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:53:39.683689027 (15h0m53.67572445s) [noise=true , address=77.90.31.12:4615 , piece_id=NMJOHPWMRKORZZUM4PTR6LNZLZMQOQNQCMWNXO6KWPZYCWKUGGLQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:53:39.685415631 (15h0m53.677451054s) [noise=true , address=45.91.116.14:4206 , piece_id=VGCENMRZ2CHRM6CTEHUHUWBCKCVBBT54IR77GRTNKTKZP3224XHA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:53:42.703540488 (15h0m56.695575911s) [noise=true , address=77.90.31.18:4827 , piece_id=WQBN3ZFG5UG4HNGEMNDHEYVQUE3MVVEPLODTYV4IFPPWCU3BHSZA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:53:44.000308116 (15h0m57.992343539s) [noise=true , address=45.91.116.4:4945 , piece_id=A7PT4CV2DRRZ65GYJIRJPVWTEGPIVGQ4AR4AZGR6G2LP4FB663BA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:53:44.435912644 (15h0m58.427948067s) [noise=true , address=104.36.82.60:4369 , piece_id=XTI7DGTFBRV5EVGZ2Y7YZS667SXY3HQ4KBNT4IHE6T63ITRM72WA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: <nil> Aug 29 07:54:36.530229948 (15h1m50.522265371s) [noise=true , address=104.36.82.48:4576 , piece_id=HBDKDIYCFS65VTUBKKYMHUA7HBQOG5H4LFJNMPS52FYV64EQCKZQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:1Ckqi1hws3KtSMmHzNt1SppBgWduvow9Aic2Zap2UdMf2W3FZC, address:104.36.82.48:4576): protocol: write tcp 188.166.225.170:44928->104.36.82.48:4576: use of closed network connection; write tcp 188.166.225.170:44928->104.36.82.48:4576: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44928->104.36.82.48:4576: use of closed network connection Aug 29 07:54:36.530276678 (15h1m50.522312101s) [noise=true , address=45.91.116.6:4992 , piece_id=QZ56OEIQJKBF7VPWQTWGOUCTQDDFOVFVYKRHDY25HSCE4EFMU5CQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:12ai9G3ULmwAy4zkKPUonML5fgxZGvJJgmqQeGfYHWqUKpehgtx, address:45.91.116.6:4992): protocol: write tcp 188.166.225.170:39650->45.91.116.6:4992: use of closed network connection; write tcp 188.166.225.170:39650->45.91.116.6:4992: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39650->45.91.116.6:4992: use of closed network connection Aug 29 07:54:36.530314540 (15h1m50.522349963s) [noise=true , address=104.36.82.4:4812 , piece_id=H2CWMBUX23NXQBRJECLHY44NYHMISBWEQ3VETQPBKSZAKIUD3PTA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:12gTRhEnzLoKmQYRttr4hwiTbJ4y3yqMUS1Qg7F2yohb81sd5KV, address:104.36.82.4:4812): protocol: write tcp 188.166.225.170:38504->104.36.82.4:4812: use of closed network connection; write tcp 188.166.225.170:38504->104.36.82.4:4812: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38504->104.36.82.4:4812: use of closed network connection Aug 29 07:54:36.530411636 (15h1m50.522447059s) [noise=true , address=77.90.31.17:4804 , piece_id=NIMVZJCC5SPO6BQZX34UFZ5KSNA2PMY6BKFLM4XXUM5ZK4YWE4OA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: read tcp 188.166.225.170:45802->77.90.31.17:4804: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:36.530471921 (15h1m50.522507344s) [noise=true , address=77.90.31.16:4757 , piece_id=YHJFXQXSHQEUDZHI4FRWNKGAHIPMXY2AA6NTJDFPPM2DLTWEBQLQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: read tcp 188.166.225.170:44348->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:36.530483683 (15h1m50.522519106s) [noise=true , address=104.36.82.53:4122 , piece_id=K6ATTT6O5JTL464P7ZNYARAQZYEVFDIWI62ZHJHRF7IXC6OPVE4A, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:124d52DhtbtwipVpZuWdpFTQAttR18hy1K1BbokNRX4R1bLtzTi, address:104.36.82.53:4122): protocol: write tcp 188.166.225.170:45482->104.36.82.53:4122: use of closed network connection; write tcp 188.166.225.170:45482->104.36.82.53:4122: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45482->104.36.82.53:4122: use of closed network connection Aug 29 07:54:36.530510024 (15h1m50.522545447s) [noise=true , address=77.90.31.11:4581 , piece_id=5DD4Q5AOAQCOEOQQVPSFBRL7AB5KM4XGLSV6PEE3MT4EYNGK26CA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:1MP1x3VuzX7cQPmD9pY3Cw1v6W2Q5LqUDdKesqX31vL9JLTRAp, address:77.90.31.11:4581): protocol: read tcp 188.166.225.170:36882->77.90.31.11:4581: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:36.530533399 (15h1m50.522568822s) [noise=true , address=77.90.31.10:4531 , piece_id=QBUS2SKMW7ICD3AE5RQPAKX4VPGW7VDT4L3FEUMHHM4DTNXNQSGQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt, address:77.90.31.10:4531): protocol: read tcp 188.166.225.170:42256->77.90.31.10:4531: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:36.530541415 (15h1m50.522576838s) [noise=true , address=77.90.31.14:4689 , piece_id=ADUSVK26QIZ2H7BCXLC6MUNEZC2VL5RPDOD3AKVZ26RST7CRKKHQ, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:1bzvSPximqxjmXA4xtXZzD8Xyp27KURJ3oH1zCvbPmPwaLkuhM, address:77.90.31.14:4689): protocol: read tcp 188.166.225.170:41832->77.90.31.14:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:36.530560681 (15h1m50.522596104s) [noise=true , address=104.36.82.23:4455 , piece_id=JMWZFLN3LYXUDAWTS5Y6CB5TJ6XXTSSUZRFUJRZQLR6G6VGEQFTA, seg_pos={0 0}, upload=15505]: Done uploading piece. err: ecclient: upload failed (node:1wsyjF5X3iPrJsezUjakUArxc8K88T36yT4rE3yu6q9BMKfycm, address:104.36.82.23:4455): protocol: read tcp 188.166.225.170:58580->104.36.82.23:4455: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:36.530581821 (15h1m50.522617244s) [seg_pos={0 0}, upload=15505]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Aug 29 07:54:36.776989200 (15h1m50.769024623s) [upload=15505]: Done uploading segments... Aug 29 07:54:36.777013576 (15h1m50.769048999s) [upload=15505]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 1m0.24855927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 853.524246ms remote: "tcp:13.203.125.58:443" response headers: Cache-Control=private Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 07:54:20 GMT Content-Type=text/html Set-Cookie=_cfuvid=baRyCvIle5creXv8xl3SabWb.hIg09mAkxJDxSWVzBM-1756454059979-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Ray=976a7ad09c691c69-BOM Cf-Cache-Status=BYPASS target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:54:20 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 853.551647ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 32 out of 60 is failed (threshold=3) [.....................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.259269357s FAIL (2025-08-29 07:54:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== .116.4:4937 , piece_id=DBSFDUXOOCEBE7JLGNEYVLQQ45XTDSHOPKZWPIHXF6G32IQZAISQ, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.573324453 (15h1m0.565359876s) [noise=true , address=45.91.116.10:4083 , piece_id=2Q7UAVITDTRHQF5ZCG6MB5WYREZ6QH4ZCZJRDK4VO63MOZZAXMPA, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.573646789 (15h1m0.565682212s) [noise=true , address=104.36.82.10:4077 , piece_id=6A3FZPBG7JFY32D7Z4DCUWPK7IBKXVCFZHUYVJZSQHUEPSYYKBTQ, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.573949208 (15h1m0.565984621s) [noise=true , address=45.91.116.7:4009 , piece_id=6CD3JSATOP3455RH7BJLGIGGLJ3HDRT6FCPSHZBAMJCJWSAANQJQ, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.574264592 (15h1m0.566300015s) [noise=true , address=77.90.31.18:4807 , piece_id=EXJ2Q5BVZ5NDCIDM6XLL4LO5CMEQZLC7DUZOMTU6NK2BMTKZ63GA, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.574533366 (15h1m0.566568779s) [noise=true , address=104.36.82.14:4223 , piece_id=TBN6CBBMXOEDU3QDZL34P7LBUALSMCIJPHQCY6UYN32PQUIO3SYQ, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.574724292 (15h1m0.566759715s) [noise=true , address=45.91.116.8:4047 , piece_id=UWWZENLCI3ARHGYOIN2SQ7YXV3YSGMGMZXGQD2F2UZTMBVJWG7QA, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.574916820 (15h1m0.566952243s) [noise=true , address=104.36.82.13:4185 , piece_id=7W6FNXTXPVVJHZBACXGK4TPTMASBKR7JQGZEEZCNIJZE6AE237SQ, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.575115690 (15h1m0.567151113s) [noise=true , address=104.36.82.2:4732 , piece_id=5G7ZRDLDV7IL4TB353QA37H25QQBCD2VGSHJTI2NPIPWAKG4HXBA, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.575364396 (15h1m0.567399819s) [noise=true , address=77.90.31.16:4733 , piece_id=MC6XGE3BFD7WKUSV37ZMC6AYHPDDOZRLZI23FXAWDLPIFB26ZWGA, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.575597011 (15h1m0.567632434s) [noise=true , address=45.91.116.9:4261 , piece_id=4UVNFCRUC75LSYXGOL3ENGL6VEZXUP3C3B6AR3GF67YGUVSHGUPQ, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.575793277 (15h1m0.5678287s) [noise=true , address=77.90.31.14:4662 , piece_id=MECMHJNUT3ETK3X2HT6DPTN3OCEHDOMLZ4I3G5QAWHMODMXA55BA, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.575983942 (15h1m0.568019365s) [noise=true , address=77.90.31.13:4628 , piece_id=EDFM35MIN6RZLQ2C6HMAI25LEECWZY5UBXVEADVMRV4Y3MUDYFGQ, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:46.576176531 (15h1m0.568211954s) [noise=true , address=45.91.116.12:4226 , piece_id=CDVP4OJDIN3QPSSHIGVQPPABYVEJAZPDASBS4U7YIIPZYHKFZDNA, seg_pos={0 0}, upload=15510]: Uploading piece... Aug 29 07:53:48.399015028 (15h1m2.391050441s) [upload=15510]: Next returned nil segment Aug 29 07:53:48.399032971 (15h1m2.391068394s) [upload=15510]: Waiting for error group managing segments... Aug 29 07:53:48.688521153 (15h1m2.680556566s) [noise=true , address=77.90.31.19:4842 , piece_id=KAV3EYENPWXD4TGXCGY6HMNZMQYYDWNKTO2JCLT775D5DPZ2SW7Q, seg_pos={0 0}, upload=15510]: Done uploading piece. err: <nil> Aug 29 07:53:48.917568543 (15h1m2.909603976s) [noise=true , address=77.90.31.13:4628 , piece_id=EDFM35MIN6RZLQ2C6HMAI25LEECWZY5UBXVEADVMRV4Y3MUDYFGQ, seg_pos={0 0}, upload=15510]: Done uploading piece. err: <nil> Aug 29 07:53:48.944497781 (15h1m2.936533204s) [noise=true , address=45.91.116.9:4261 , piece_id=4UVNFCRUC75LSYXGOL3ENGL6VEZXUP3C3B6AR3GF67YGUVSHGUPQ, seg_pos={0 0}, upload=15510]: Done uploading piece. err: <nil> Aug 29 07:53:49.114198675 (15h1m3.106234098s) [noise=true , address=104.36.82.13:4185 , piece_id=7W6FNXTXPVVJHZBACXGK4TPTMASBKR7JQGZEEZCNIJZE6AE237SQ, seg_pos={0 0}, upload=15510]: Done uploading piece. err: <nil> Aug 29 07:53:49.779067197 (15h1m3.771102621s) [noise=true , address=77.90.31.18:4807 , piece_id=EXJ2Q5BVZ5NDCIDM6XLL4LO5CMEQZLC7DUZOMTU6NK2BMTKZ63GA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: <nil> Aug 29 07:53:54.593744244 (15h1m8.585779667s) [noise=true , address=45.91.116.10:4083 , piece_id=2Q7UAVITDTRHQF5ZCG6MB5WYREZ6QH4ZCZJRDK4VO63MOZZAXMPA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: <nil> Aug 29 07:54:15.502874589 (15h1m29.494910012s) [noise=true , address=45.91.116.12:4226 , piece_id=CDVP4OJDIN3QPSSHIGVQPPABYVEJAZPDASBS4U7YIIPZYHKFZDNA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:49680->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:49680->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49680->45.91.116.12:4226: use of closed network connection Aug 29 07:54:15.502929524 (15h1m29.494964947s) [noise=true , address=104.36.82.2:4732 , piece_id=5G7ZRDLDV7IL4TB353QA37H25QQBCD2VGSHJTI2NPIPWAKG4HXBA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: write tcp 188.166.225.170:59778->104.36.82.2:4732: use of closed network connection; write tcp 188.166.225.170:59778->104.36.82.2:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59778->104.36.82.2:4732: use of closed network connection Aug 29 07:54:15.502985271 (15h1m29.495020694s) [noise=true , address=45.91.116.8:4047 , piece_id=UWWZENLCI3ARHGYOIN2SQ7YXV3YSGMGMZXGQD2F2UZTMBVJWG7QA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 188.166.225.170:51602->45.91.116.8:4047: use of closed network connection; write tcp 188.166.225.170:51602->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51602->45.91.116.8:4047: use of closed network connection Aug 29 07:54:15.503084952 (15h1m29.495120375s) [noise=true , address=104.36.82.10:4077 , piece_id=6A3FZPBG7JFY32D7Z4DCUWPK7IBKXVCFZHUYVJZSQHUEPSYYKBTQ, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:104.36.82.10:4077): protocol: write tcp 188.166.225.170:47514->104.36.82.10:4077: use of closed network connection; write tcp 188.166.225.170:47514->104.36.82.10:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47514->104.36.82.10:4077: use of closed network connection Aug 29 07:54:15.503133214 (15h1m29.495168637s) [noise=true , address=104.36.82.14:4223 , piece_id=TBN6CBBMXOEDU3QDZL34P7LBUALSMCIJPHQCY6UYN32PQUIO3SYQ, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: read tcp 188.166.225.170:32932->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:15.503163592 (15h1m29.495199015s) [noise=true , address=45.91.116.14:4191 , piece_id=62AA3TSZPYIM56NSXTZHW5QAJEH53U4LGEEOFWNVX6ZYTHM4OSBA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 188.166.225.170:33590->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:15.503198068 (15h1m29.495233501s) [noise=true , address=77.90.31.14:4662 , piece_id=MECMHJNUT3ETK3X2HT6DPTN3OCEHDOMLZ4I3G5QAWHMODMXA55BA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:41028->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:15.503220682 (15h1m29.495256105s) [noise=true , address=45.91.116.4:4937 , piece_id=DBSFDUXOOCEBE7JLGNEYVLQQ45XTDSHOPKZWPIHXF6G32IQZAISQ, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: read tcp 188.166.225.170:34358->45.91.116.4:4937: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:15.503234028 (15h1m29.495269451s) [noise=true , address=77.90.31.16:4733 , piece_id=MC6XGE3BFD7WKUSV37ZMC6AYHPDDOZRLZI23FXAWDLPIFB26ZWGA, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: read tcp 188.166.225.170:48930->77.90.31.16:4733: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:15.503290916 (15h1m29.495326339s) [noise=true , address=45.91.116.7:4009 , piece_id=6CD3JSATOP3455RH7BJLGIGGLJ3HDRT6FCPSHZBAMJCJWSAANQJQ, seg_pos={0 0}, upload=15510]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 188.166.225.170:57384->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Aug 29 07:54:15.503306686 (15h1m29.495342109s) [seg_pos={0 0}, upload=15510]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 29 07:54:15.760137348 (15h1m29.752172771s) [upload=15510]: Done uploading segments... Aug 29 07:54:15.760163639 (15h1m29.752199062s) [upload=15510]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 30.259284585s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 24 out of 60 is failed (threshold=3) [.............................XX.......XXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.258072901s FAIL (2025-08-29 07:54:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== ss=45.91.116.11:4150 , piece_id=Y3FB76BRWG4FUDTGPBYHU44CZVCJQL4MLRDMRSWPOHWGG3QUJDPA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.887849196 (15h0m18.879884619s) [noise=true , address=45.91.116.4:4949 , piece_id=GC5O6IR2SEXEZ5ET7DRJOKJ5VBB6CM76J6EV7YFJDZFISRK7TIUA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.887901186 (15h0m18.879936609s) [noise=true , address=77.90.31.15:4727 , piece_id=2OTKZMIH37RIU54SQWEYGOH352FC2QPJ7FIHYF2XRJIPXKHPUXWA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.888099455 (15h0m18.880134878s) [noise=true , address=79.127.219.51:4192 , piece_id=TEW3IM5A4MMYGFA3G3CSK6TCZZNACQYB62CSVWZVWY633M2M2EPQ, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.888185339 (15h0m18.880220762s) [noise=true , address=77.90.31.17:4774 , piece_id=KU7IVBRUG6ZFFO45OPKRZI2XH6GVIIVPBMDNR4JZ34KAQ7WYVJDQ, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.888341658 (15h0m18.880377081s) [noise=true , address=104.36.82.60:4358 , piece_id=HUXXTFH6GT5MKTVQZQRGOUNBDC7QOUJW4EADHVTZTR3PH4TV6DDA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.888488779 (15h0m18.880524203s) [noise=true , address=45.91.116.10:4112 , piece_id=2LKLWABT2DP567GMXCC5RYALUJRMSLE7JWTXS3H3H7ZY74EL6CKA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.888556890 (15h0m18.880592313s) [noise=true , address=77.90.31.13:4653 , piece_id=RBEBXUL2HXWLSUCSQRJ3X2ALSMOTBT75EDV3MNT4HTFCQWKOKC3A, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.888767022 (15h0m18.880802445s) [noise=true , address=156.146.43.225:4445 , piece_id=PIV4QKBMQ2OXDBCHGQUPJGTSKN5SERPHTJBPPVDQXVO7RHWWLEEA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.888792581 (15h0m18.880828004s) [noise=true , address=45.91.116.9:4288 , piece_id=B3JDHW4TCQWIGNRLVV3YHBJCLAY57SU4GOPOKEBHJVONK4JFTKAA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.889000799 (15h0m18.881036213s) [noise=true , address=77.90.31.16:4736 , piece_id=ZMPBKL3HIHAFOZCPICLZ25NAT6ABWQYNXPK4X7GAIMK7FZCZPEYQ, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.889023914 (15h0m18.881059337s) [noise=true , address=79.127.219.47:4069 , piece_id=G4FBRVDLGAXVD5MWRIHUN4SRHBESG6BWMESK4NYDQANQGTRVDQ5Q, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.889300693 (15h0m18.881336116s) [noise=true , address=77.90.31.19:4875 , piece_id=6NFEGKS6LVCAVTW7UCP45P25RFRHL3HTK65MYYZHUTWCKFMFLUEA, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.889480978 (15h0m18.881516401s) [noise=true , address=77.90.31.12:4622 , piece_id=HIXGKF6WIIWPOLOL37KNZ4AJCBEGSBFCLG6WNSJKURM7YXFLAI5Q, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.889508530 (15h0m18.881543943s) [noise=true , address=79.127.219.48:4101 , piece_id=DE2SA2IERDDOROZ2OVUUVSEQ3XK4BMLU62M2MI4KSDKCKDL722CQ, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.889793997 (15h0m18.882385905s) [noise=true , address=77.90.31.11:4582 , piece_id=5QA4HBWMFWUTX7FKSNJZKJW7HIARCWYN6IV7YMND4BMKOHEHANDQ, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:04.890702345 (15h0m18.882737768s) [noise=true , address=45.91.116.5:4317 , piece_id=46NU7ZAVPOP27PPDRX55FFIF6EOTIBAUL656HGKAR5GPV67NOJ3Q, seg_pos={0 0}, upload=15499]: Uploading piece... Aug 29 07:53:06.391014436 (15h0m20.38304986s) [upload=15499]: Next returned nil segment Aug 29 07:53:06.391036098 (15h0m20.383071521s) [upload=15499]: Waiting for error group managing segments... Aug 29 07:53:06.771870525 (15h0m20.763905948s) [noise=true , address=79.127.219.47:4069 , piece_id=G4FBRVDLGAXVD5MWRIHUN4SRHBESG6BWMESK4NYDQANQGTRVDQ5Q, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:06.780072460 (15h0m20.772107883s) [noise=true , address=79.127.219.51:4192 , piece_id=TEW3IM5A4MMYGFA3G3CSK6TCZZNACQYB62CSVWZVWY633M2M2EPQ, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:06.829959737 (15h0m20.82199518s) [noise=true , address=156.146.43.225:4445 , piece_id=PIV4QKBMQ2OXDBCHGQUPJGTSKN5SERPHTJBPPVDQXVO7RHWWLEEA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:06.843829926 (15h0m20.835865379s) [noise=true , address=79.127.219.48:4101 , piece_id=DE2SA2IERDDOROZ2OVUUVSEQ3XK4BMLU62M2MI4KSDKCKDL722CQ, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:06.881255548 (15h0m20.873290961s) [noise=true , address=45.91.116.9:4288 , piece_id=B3JDHW4TCQWIGNRLVV3YHBJCLAY57SU4GOPOKEBHJVONK4JFTKAA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:07.074494881 (15h0m21.066530304s) [noise=true , address=77.90.31.13:4653 , piece_id=RBEBXUL2HXWLSUCSQRJ3X2ALSMOTBT75EDV3MNT4HTFCQWKOKC3A, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:09.558172281 (15h0m23.550207704s) [noise=true , address=77.90.31.19:4875 , piece_id=6NFEGKS6LVCAVTW7UCP45P25RFRHL3HTK65MYYZHUTWCKFMFLUEA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:09.883819822 (15h0m23.875855245s) [noise=true , address=77.90.31.12:4622 , piece_id=HIXGKF6WIIWPOLOL37KNZ4AJCBEGSBFCLG6WNSJKURM7YXFLAI5Q, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:10.589742269 (15h0m24.581777692s) [noise=true , address=45.91.116.11:4150 , piece_id=Y3FB76BRWG4FUDTGPBYHU44CZVCJQL4MLRDMRSWPOHWGG3QUJDPA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:12.526615528 (15h0m26.518650951s) [noise=true , address=45.91.116.4:4949 , piece_id=GC5O6IR2SEXEZ5ET7DRJOKJ5VBB6CM76J6EV7YFJDZFISRK7TIUA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:53:15.122425627 (15h0m29.11446105s) [noise=true , address=104.36.82.60:4358 , piece_id=HUXXTFH6GT5MKTVQZQRGOUNBDC7QOUJW4EADHVTZTR3PH4TV6DDA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: <nil> Aug 29 07:54:03.645151199 (15h1m17.637186622s) [noise=true , address=45.91.116.5:4317 , piece_id=46NU7ZAVPOP27PPDRX55FFIF6EOTIBAUL656HGKAR5GPV67NOJ3Q, seg_pos={0 0}, upload=15499]: Done uploading piece. err: ecclient: upload failed (node:1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, address:45.91.116.5:4317): protocol: write tcp 188.166.225.170:47922->45.91.116.5:4317: use of closed network connection; write tcp 188.166.225.170:47922->45.91.116.5:4317: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47922->45.91.116.5:4317: use of closed network connection Aug 29 07:54:03.645375809 (15h1m17.637411233s) [noise=true , address=45.91.116.10:4112 , piece_id=2LKLWABT2DP567GMXCC5RYALUJRMSLE7JWTXS3H3H7ZY74EL6CKA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: ecclient: upload failed (node:1Wy976SVyCJwVBqfYneFHXjiRx8U2iKhdjzsbjyiAgsGUJS4nX, address:45.91.116.10:4112): protocol: write tcp 188.166.225.170:44434->45.91.116.10:4112: use of closed network connection; write tcp 188.166.225.170:44434->45.91.116.10:4112: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44434->45.91.116.10:4112: use of closed network connection Aug 29 07:54:03.645423189 (15h1m17.637458612s) [noise=true , address=77.90.31.15:4727 , piece_id=2OTKZMIH37RIU54SQWEYGOH352FC2QPJ7FIHYF2XRJIPXKHPUXWA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 188.166.225.170:47694->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:03.645455160 (15h1m17.637490583s) [noise=true , address=77.90.31.17:4774 , piece_id=KU7IVBRUG6ZFFO45OPKRZI2XH6GVIIVPBMDNR4JZ34KAQ7WYVJDQ, seg_pos={0 0}, upload=15499]: Done uploading piece. err: ecclient: upload failed (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y, address:77.90.31.17:4774): protocol: read tcp 188.166.225.170:48590->77.90.31.17:4774: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:03.645498213 (15h1m17.637533636s) [noise=true , address=77.90.31.11:4582 , piece_id=5QA4HBWMFWUTX7FKSNJZKJW7HIARCWYN6IV7YMND4BMKOHEHANDQ, seg_pos={0 0}, upload=15499]: Done uploading piece. err: ecclient: upload failed (node:17VVqv2A8JgKbRYuqxsdnPhomFxdBaznCHMDV21XFsCpuAFBNx, address:77.90.31.11:4582): protocol: read tcp 188.166.225.170:56404->77.90.31.11:4582: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:03.645505367 (15h1m17.63754083s) [noise=true , address=77.90.31.16:4736 , piece_id=ZMPBKL3HIHAFOZCPICLZ25NAT6ABWQYNXPK4X7GAIMK7FZCZPEYQ, seg_pos={0 0}, upload=15499]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 188.166.225.170:56752->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:03.645545023 (15h1m17.637580446s) [noise=true , address=64.49.13.26:4954 , piece_id=4GAR3SPZQMDLFTPY65IW5W6TOESQEJERKXQAJGQMOQT2TTUN3FIA, seg_pos={0 0}, upload=15499]: Done uploading piece. err: ecclient: upload failed (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo, address:64.49.13.26:4954): protocol: read tcp 188.166.225.170:57768->64.49.13.26:4954: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:54:03.645573908 (15h1m17.637609331s) [seg_pos={0 0}, upload=15499]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Aug 29 07:54:03.900231361 (15h1m17.892266784s) [upload=15499]: Done uploading segments... Aug 29 07:54:03.900282108 (15h1m17.892317541s) [upload=15499]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.258092268s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 405.956466ms remote: "tcp:13.233.175.166:443" response headers: Date=Fri, 29 Aug 2025 07:53:41 GMT Cf-Cache-Status=HIT Age=218476 X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Cf-Ray=976a79dedf563fef-BOM X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=G5Mk5LEPQvBhi3KACn6yU9xvjZT4MBYaWqMJbaSIgIQ-1756454021028-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Vary=Accept-Encoding target: https://www.storj.io/ FAIL (2025-08-29 07:53:41 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 405.977437ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 738.364623ms remote: "tcp:3.109.243.18:443" response headers: Set-Cookie=_cfuvid=xLJJiaEeC3pClljYatDSdGeEVNx7xPYSJuyxx6ZDCPo-1756454017985-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 07:53:38 GMT Cf-Cache-Status=BYPASS Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Ray=976a79c96ee357ad-BOM Cache-Control=private target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:53:38 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 738.414328ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 24 out of 60 is failed (threshold=3) [............................XX........XXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.262086384s FAIL (2025-08-29 07:53:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== Aug 29 07:52:36.761745794 (14h59m50.753781217s) [upload=15490]: Starting upload Aug 29 07:52:36.761879870 (14h59m50.753915293s) [upload=15490]: Done starting upload Aug 29 07:52:36.761958781 (14h59m50.753994204s) [upload=15490]: Uploading segments... Aug 29 07:52:36.762374286 (14h59m50.754409809s) [upload=15490]: Got next segment. Inline: false Aug 29 07:52:36.762422929 (14h59m50.754458353s) [upload=15490]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:52:36.762430373 (14h59m50.754465807s) [upload=15490]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:52:37.269595649 (14h59m51.261631072s) [seg_pos={0 0}, upload=15490]: Begin upload segment... Aug 29 07:52:37.269640545 (14h59m51.261675968s) [seg_pos={0 0}, upload=15490]: Done begin upload segment. Aug 29 07:52:37.269662787 (14h59m51.26169821s) [noise=true , address=77.90.31.18:4833 , piece_id=XAKYIG3VCHBVBOFRCAYY27UNLI4A6IKFFP4E66AUG34OBXT2OABQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.269760845 (14h59m51.261796268s) [noise=true , address=77.90.31.14:4676 , piece_id=BY2TULGMHFEVB2TVNA52NNYEZZ52W2Q5NO6TQ5EWKP6SM6PZPPDQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.270049698 (14h59m51.262085121s) [noise=true , address=156.146.43.225:4446 , piece_id=6ZHHPNPNCAEXIFOFQWL2YZIKU246HQLTJDMDSEHDJHPIHG264HXQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.270307511 (14h59m51.262342934s) [noise=true , address=79.127.220.97:4375 , piece_id=NP6M6X6TZJQZMQHKVZWBK6B2P7KONAPMEJ5NQEQVPOQKWOAYQOHQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.270382795 (14h59m51.262418218s) [noise=true , address=77.90.31.21:4891 , piece_id=INYZOBTJBGQVEIGGDAU7GWWP6AM2IJDGUXRDPN6D43JMHRZVUF5Q, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.270664303 (14h59m51.262699727s) [noise=true , address=104.36.82.50:4013 , piece_id=2LRJTBORFZEGHTPBFKFBHPQWVX3C76C7VSNKPCZRHNBXRCJEKPSQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.270734879 (14h59m51.262770302s) [noise=true , address=77.90.31.19:4854 , piece_id=IH7IVUS7PG2E27J5M7CJWLQQ765VQ4TSJKPHPEC23EO57IPV6WEQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.270935252 (14h59m51.262970665s) [noise=true , address=64.49.13.138:4482 , piece_id=PIU4IMBJIG6KJPI5K6LVDABYFLVSLWBVC6QGIYTNY66GWUCD22TQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.271110808 (14h59m51.263146231s) [noise=true , address=45.91.116.6:4988 , piece_id=QH4ROKCJ6OLPTGA3PZKSBHM3RPXAQUDL4J6WIZ624237BOU5NCOQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.271243191 (14h59m51.263278614s) [noise=true , address=45.91.116.4:4970 , piece_id=B5KXQ6AEEDQBADTXLSDTTYGRMNEEJRWCLALIR6R7AKETYSKZ6BKQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.271420621 (14h59m51.263456044s) [noise=true , address=77.90.31.16:4741 , piece_id=P5ERA67N62SQ47WNQEPL33NQQIL3JCNXSES24UKXYFZMGRAVEQKQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.271468762 (14h59m51.263504185s) [noise=true , address=79.127.205.245:4236 , piece_id=227DP3LWJEBI3QJWU4TCJ6O45VPG3XLVJW2NPBBIWOT53DFXGPQQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.271675528 (14h59m51.263710952s) [noise=true , address=104.36.82.60:4343 , piece_id=XOLOTQ4OJCQTTI24OSNJXDUDR25MHBRUY3BHMMY3IPL237T46KYA, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.271689294 (14h59m51.263724707s) [noise=true , address=79.127.219.51:4192 , piece_id=567UBWE2NTZUXIV6ADUUGSNKVI5KWEH7G52OKSN7VB6WJIUXBCNA, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.271894267 (14h59m51.26392969s) [noise=true , address=77.90.31.13:4658 , piece_id=2WOYQQNVEQJXNAK4RWBNHVQRPTHB3Q67NVSJVWRMYNBL4VHQZRTQ, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.272023925 (14h59m51.264059348s) [noise=true , address=104.36.82.5:4855 , piece_id=IV7EXFVLTLIQYJX4IGMW3V4URMWZXUIXVTZQEGYC2MBZ62B6HIWA, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.272304372 (14h59m51.264339785s) [noise=true , address=79.127.205.246:4258 , piece_id=LO5BOZALAPSYDE5S3QCZKDJ7ELSBSZQJGUKB22PGWERCUN7NRF2A, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:37.273908551 (14h59m51.265943974s) [noise=true , address=77.90.31.17:4780 , piece_id=OR65HG52J6JG73VO4RX223PJKCNINHKSFNHQWKQXCGKBUQG7BU5Q, seg_pos={0 0}, upload=15490]: Uploading piece... Aug 29 07:52:38.397883711 (14h59m52.389919134s) [upload=15490]: Next returned nil segment Aug 29 07:52:38.397903058 (14h59m52.389938481s) [upload=15490]: Waiting for error group managing segments... Aug 29 07:52:38.687453859 (14h59m52.679489282s) [noise=true , address=79.127.205.246:4258 , piece_id=LO5BOZALAPSYDE5S3QCZKDJ7ELSBSZQJGUKB22PGWERCUN7NRF2A, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:52:38.694209876 (14h59m52.686245329s) [noise=true , address=79.127.205.245:4236 , piece_id=227DP3LWJEBI3QJWU4TCJ6O45VPG3XLVJW2NPBBIWOT53DFXGPQQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:52:39.117872915 (14h59m53.109908338s) [noise=true , address=79.127.220.97:4375 , piece_id=NP6M6X6TZJQZMQHKVZWBK6B2P7KONAPMEJ5NQEQVPOQKWOAYQOHQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:52:39.244269015 (14h59m53.236304438s) [noise=true , address=156.146.43.225:4446 , piece_id=6ZHHPNPNCAEXIFOFQWL2YZIKU246HQLTJDMDSEHDJHPIHG264HXQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:52:39.246805578 (14h59m53.238840991s) [noise=true , address=79.127.219.51:4192 , piece_id=567UBWE2NTZUXIV6ADUUGSNKVI5KWEH7G52OKSN7VB6WJIUXBCNA, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:52:39.550706348 (14h59m53.542741771s) [noise=true , address=77.90.31.16:4741 , piece_id=P5ERA67N62SQ47WNQEPL33NQQIL3JCNXSES24UKXYFZMGRAVEQKQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:52:44.087421954 (14h59m58.079457378s) [noise=true , address=77.90.31.19:4854 , piece_id=IH7IVUS7PG2E27J5M7CJWLQQ765VQ4TSJKPHPEC23EO57IPV6WEQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:52:45.814027849 (14h59m59.806063262s) [noise=true , address=104.36.82.60:4343 , piece_id=XOLOTQ4OJCQTTI24OSNJXDUDR25MHBRUY3BHMMY3IPL237T46KYA, seg_pos={0 0}, upload=15490]: Done uploading piece. err: <nil> Aug 29 07:53:36.024740145 (15h0m50.016775568s) [noise=true , address=104.36.82.5:4855 , piece_id=IV7EXFVLTLIQYJX4IGMW3V4URMWZXUIXVTZQEGYC2MBZ62B6HIWA, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:104.36.82.5:4855): protocol: write tcp 188.166.225.170:44890->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44890->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44890->104.36.82.5:4855: use of closed network connection Aug 29 07:53:36.024901033 (15h0m50.016936456s) [noise=true , address=64.49.13.138:4482 , piece_id=PIU4IMBJIG6KJPI5K6LVDABYFLVSLWBVC6QGIYTNY66GWUCD22TQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:12joW2m4Uc87FSH65Cep1UKivUB1HG1119CQj14eWEKPcwaPsD5, address:64.49.13.138:4482): protocol: write tcp 188.166.225.170:48062->64.49.13.138:4482: use of closed network connection; write tcp 188.166.225.170:48062->64.49.13.138:4482: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48062->64.49.13.138:4482: use of closed network connection Aug 29 07:53:36.025012927 (15h0m50.01704835s) [noise=true , address=104.36.82.50:4013 , piece_id=2LRJTBORFZEGHTPBFKFBHPQWVX3C76C7VSNKPCZRHNBXRCJEKPSQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, address:104.36.82.50:4013): protocol: write tcp 188.166.225.170:44264->104.36.82.50:4013: use of closed network connection; write tcp 188.166.225.170:44264->104.36.82.50:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44264->104.36.82.50:4013: use of closed network connection Aug 29 07:53:36.025069746 (15h0m50.017105169s) [noise=true , address=77.90.31.13:4658 , piece_id=2WOYQQNVEQJXNAK4RWBNHVQRPTHB3Q67NVSJVWRMYNBL4VHQZRTQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: write tcp 188.166.225.170:36802->77.90.31.13:4658: use of closed network connection; write tcp 188.166.225.170:36802->77.90.31.13:4658: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36802->77.90.31.13:4658: use of closed network connection Aug 29 07:53:36.025117317 (15h0m50.01715274s) [noise=true , address=77.90.31.21:4891 , piece_id=INYZOBTJBGQVEIGGDAU7GWWP6AM2IJDGUXRDPN6D43JMHRZVUF5Q, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g, address:77.90.31.21:4891): protocol: read tcp 188.166.225.170:46226->77.90.31.21:4891: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:53:36.025150220 (15h0m50.017185643s) [noise=true , address=45.91.116.4:4970 , piece_id=B5KXQ6AEEDQBADTXLSDTTYGRMNEEJRWCLALIR6R7AKETYSKZ6BKQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:1zHCVWGoutBZ3Du4xTCCJGALvrAZwB7cmC1vsRGj5LcwyfW8Qe, address:45.91.116.4:4970): protocol: read tcp 188.166.225.170:44870->45.91.116.4:4970: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:53:36.025400929 (15h0m50.017436352s) [noise=true , address=77.90.31.14:4676 , piece_id=BY2TULGMHFEVB2TVNA52NNYEZZ52W2Q5NO6TQ5EWKP6SM6PZPPDQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC, address:77.90.31.14:4676): protocol: write tcp 188.166.225.170:41238->77.90.31.14:4676: use of closed network connection; write tcp 188.166.225.170:41238->77.90.31.14:4676: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41238->77.90.31.14:4676: use of closed network connection Aug 29 07:53:36.025482646 (15h0m50.017518069s) [noise=true , address=77.90.31.17:4780 , piece_id=OR65HG52J6JG73VO4RX223PJKCNINHKSFNHQWKQXCGKBUQG7BU5Q, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF, address:77.90.31.17:4780): protocol: write tcp 188.166.225.170:50290->77.90.31.17:4780: use of closed network connection; write tcp 188.166.225.170:50290->77.90.31.17:4780: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50290->77.90.31.17:4780: use of closed network connection Aug 29 07:53:36.025539144 (15h0m50.017574567s) [noise=true , address=77.90.31.18:4833 , piece_id=XAKYIG3VCHBVBOFRCAYY27UNLI4A6IKFFP4E66AUG34OBXT2OABQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:1FbVbo8kGy1aaFyCk2noiXNUJHtosFJHFykBMRecGd5Kj5gjEp, address:77.90.31.18:4833): protocol: write tcp 188.166.225.170:47198->77.90.31.18:4833: use of closed network connection; write tcp 188.166.225.170:47198->77.90.31.18:4833: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47198->77.90.31.18:4833: use of closed network connection Aug 29 07:53:36.025566306 (15h0m50.017601729s) [noise=true , address=45.91.116.6:4988 , piece_id=QH4ROKCJ6OLPTGA3PZKSBHM3RPXAQUDL4J6WIZ624237BOU5NCOQ, seg_pos={0 0}, upload=15490]: Done uploading piece. err: ecclient: upload failed (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS, address:45.91.116.6:4988): protocol: write tcp 188.166.225.170:36182->45.91.116.6:4988: use of closed network connection; write tcp 188.166.225.170:36182->45.91.116.6:4988: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->45.91.116.6:4988: use of closed network connection Aug 29 07:53:36.025579341 (15h0m50.017614764s) [seg_pos={0 0}, upload=15490]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Aug 29 07:53:36.285154204 (15h0m50.277189627s) [upload=15490]: Done uploading segments... Aug 29 07:53:36.285180825 (15h0m50.277216248s) [upload=15490]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 1m0.262101734s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 31 out of 60 is failed (threshold=3) [......................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.262004948s FAIL (2025-08-29 07:53:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== 15494]: Uploading piece... Aug 29 07:52:43.483515370 (14h59m57.475550794s) [noise=true , address=104.36.82.4:4804 , piece_id=QG3OJHXPXARY2BFVKEEOQGVP7BT26GXDGVE7XDX6AYLDCYJHJY6Q, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.483956785 (14h59m57.475992198s) [noise=true , address=45.91.116.9:4262 , piece_id=XJR3DWIWHXPYE4DCM6UWJMQD2BJ2YCVBOOOSJ3UVX2PONDZCLPDA, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.483984338 (14h59m57.476019761s) [noise=true , address=45.91.116.11:4119 , piece_id=FRGWHQVCW6M6EDL4BV5NBGOGN7HSEI6PON6UAHX6WOMAG3FNOZ2A, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.484310071 (14h59m57.476345494s) [noise=true , address=77.90.31.16:4735 , piece_id=THJOK7VNKAC32U6PUPY6E7Z7ST2Q2BONGLTFWJM4MR5UYSQMLVFA, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.484380846 (14h59m57.476416279s) [noise=true , address=45.91.116.4:4940 , piece_id=ESVT4SAESLQEVDVWG5EOCSUUSUPRAP3LNJB3WDU6SV6722YRIGDQ, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.484695428 (14h59m57.476730851s) [noise=true , address=77.90.31.11:4555 , piece_id=FV7UNQS56BLMUKE6MVDMUBP7L4J4LB7FSXU53FPKLB5N4QAY5GTA, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.484820026 (14h59m57.476855449s) [noise=true , address=45.91.116.5:4298 , piece_id=WA5E5KM73MLBPILZDTMNUJIOOP5XPBFHTZDE3UP5SQKH5HUSK4AQ, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.484974793 (14h59m57.477010216s) [noise=true , address=45.91.116.8:4045 , piece_id=QHSYVHSCX4LE4C3S2PP2ZWIRSBEHE3Z4NUB2TS4FJWQADDOFCLSQ, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.485250911 (14h59m57.477286334s) [noise=true , address=104.36.82.8:4972 , piece_id=OY4S3VLLMDPYIZJS6OYGWTLWC2UZFF74GMXT4LITJNCJIOL46STQ, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.485600180 (14h59m57.477635603s) [noise=true , address=77.90.31.21:4877 , piece_id=Y76KK6ZSDFTMH7VBWX325V5V3MOTVFUB4A4WIJJ3NKSPMSYUNWMA, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.488516179 (14h59m57.480551612s) [noise=true , address=77.90.31.18:4805 , piece_id=DMTYFNANALEL3G5UQOX37I3EY5M6J2AZV4V6CPAGK7LIHFH5GEQA, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:43.489991221 (14h59m57.482026644s) [noise=true , address=45.91.116.13:4155 , piece_id=ARKU65X24CPHZYPBKJGFVHGIBN3EBNVKXME4GW7EUYQJM5EE563A, seg_pos={0 0}, upload=15494]: Uploading piece... Aug 29 07:52:45.303892290 (14h59m59.295927713s) [upload=15494]: Next returned nil segment Aug 29 07:52:45.303923009 (14h59m59.295958432s) [upload=15494]: Waiting for error group managing segments... Aug 29 07:52:45.594533498 (14h59m59.586568921s) [noise=true , address=77.90.31.18:4805 , piece_id=DMTYFNANALEL3G5UQOX37I3EY5M6J2AZV4V6CPAGK7LIHFH5GEQA, seg_pos={0 0}, upload=15494]: Done uploading piece. err: <nil> Aug 29 07:52:45.630246453 (14h59m59.622281876s) [noise=true , address=104.36.82.4:4804 , piece_id=QG3OJHXPXARY2BFVKEEOQGVP7BT26GXDGVE7XDX6AYLDCYJHJY6Q, seg_pos={0 0}, upload=15494]: Done uploading piece. err: <nil> Aug 29 07:52:45.737108588 (14h59m59.729144021s) [noise=true , address=45.91.116.10:4083 , piece_id=PSLGDRVYRDMLUFYTLV5H3OL5ALF3GDP63WWHZXTBVVXMJEXVUDJQ, seg_pos={0 0}, upload=15494]: Done uploading piece. err: <nil> Aug 29 07:52:45.754336362 (14h59m59.746371785s) [noise=true , address=45.91.116.5:4298 , piece_id=WA5E5KM73MLBPILZDTMNUJIOOP5XPBFHTZDE3UP5SQKH5HUSK4AQ, seg_pos={0 0}, upload=15494]: Done uploading piece. err: <nil> Aug 29 07:52:48.636955646 (15h0m2.62899107s) [noise=true , address=77.90.31.11:4555 , piece_id=FV7UNQS56BLMUKE6MVDMUBP7L4J4LB7FSXU53FPKLB5N4QAY5GTA, seg_pos={0 0}, upload=15494]: Done uploading piece. err: <nil> Aug 29 07:52:52.111422293 (15h0m6.103457716s) [noise=true , address=45.91.116.13:4155 , piece_id=ARKU65X24CPHZYPBKJGFVHGIBN3EBNVKXME4GW7EUYQJM5EE563A, seg_pos={0 0}, upload=15494]: Done uploading piece. err: <nil> Aug 29 07:53:12.464097362 (15h0m26.456132785s) [noise=true , address=45.91.116.4:4940 , piece_id=ESVT4SAESLQEVDVWG5EOCSUUSUPRAP3LNJB3WDU6SV6722YRIGDQ, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: read tcp 188.166.225.170:56046->45.91.116.4:4940: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Aug 29 07:53:12.464285401 (15h0m26.456320824s) [noise=true , address=45.91.116.7:4011 , piece_id=FQCNWRJL2SZYCLRCKJOVJRYHMKTMJ6S3GNVQKAGHHWJIFAHMQR5A, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:34390->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:34390->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34390->45.91.116.7:4011: use of closed network connection Aug 29 07:53:12.464359944 (15h0m26.456395367s) [noise=true , address=45.91.116.9:4262 , piece_id=XJR3DWIWHXPYE4DCM6UWJMQD2BJ2YCVBOOOSJ3UVX2PONDZCLPDA, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 188.166.225.170:45690->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:45690->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45690->45.91.116.9:4262: use of closed network connection Aug 29 07:53:12.464468592 (15h0m26.456504005s) [noise=true , address=45.91.116.11:4119 , piece_id=FRGWHQVCW6M6EDL4BV5NBGOGN7HSEI6PON6UAHX6WOMAG3FNOZ2A, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:38378->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:38378->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38378->45.91.116.11:4119: use of closed network connection Aug 29 07:53:12.464486417 (15h0m26.45652183s) [noise=true , address=104.36.82.10:4079 , piece_id=HDODKPSGD2HYQM5XXBQ72B6UEZBZ7TIYAZYAICOEEWO7FVA3S5IA, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:104.36.82.10:4079): protocol: write tcp 188.166.225.170:36878->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:36878->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36878->104.36.82.10:4079: use of closed network connection Aug 29 07:53:12.464509781 (15h0m26.456545204s) [noise=true , address=77.90.31.16:4735 , piece_id=THJOK7VNKAC32U6PUPY6E7Z7ST2Q2BONGLTFWJM4MR5UYSQMLVFA, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 188.166.225.170:37196->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:53:12.464542824 (15h0m26.456578248s) [noise=true , address=77.90.31.21:4877 , piece_id=Y76KK6ZSDFTMH7VBWX325V5V3MOTVFUB4A4WIJJ3NKSPMSYUNWMA, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 188.166.225.170:42152->77.90.31.21:4877: use of closed network connection; write tcp 188.166.225.170:42152->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42152->77.90.31.21:4877: use of closed network connection Aug 29 07:53:12.464558334 (15h0m26.456593757s) [noise=true , address=45.91.116.8:4045 , piece_id=QHSYVHSCX4LE4C3S2PP2ZWIRSBEHE3Z4NUB2TS4FJWQADDOFCLSQ, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 188.166.225.170:34526->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:34526->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34526->45.91.116.8:4045: use of closed network connection Aug 29 07:53:12.464669536 (15h0m26.456704959s) [noise=true , address=104.36.82.8:4972 , piece_id=OY4S3VLLMDPYIZJS6OYGWTLWC2UZFF74GMXT4LITJNCJIOL46STQ, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:104.36.82.8:4972): protocol: read tcp 188.166.225.170:49454->104.36.82.8:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:53:12.464704464 (15h0m26.456739887s) [noise=true , address=45.91.116.8:4047 , piece_id=Z4GSDJFCDMEOQZUS6P6HFXAFLGTZ74UQ3LBKRWLFWN3RYULXVOYA, seg_pos={0 0}, upload=15494]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 188.166.225.170:34644->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:53:12.464741484 (15h0m26.456776907s) [seg_pos={0 0}, upload=15494]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 29 07:53:12.724131585 (15h0m26.716167008s) [upload=15494]: Done uploading segments... Aug 29 07:53:12.724161462 (15h0m26.716196895s) [upload=15494]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 30.262028484s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 23 out of 60 is failed (threshold=3) [..............................XX.......XXXXXXXXXXXXXXXXXXXXX] duration: 1m0.261672695s FAIL (2025-08-29 07:53:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 7) ======LOGS====== ce... Aug 29 07:52:04.347518237 (14h59m18.33955366s) [noise=true , address=64.49.13.140:4508 , piece_id=RD5Y4PE2CACRDEGCQDGPCHPMHOFXXOXTATQMTM53DLENQHNKGXUA, seg_pos={0 0}, upload=15481]: Uploading piece... Aug 29 07:52:04.347960693 (14h59m18.339996126s) [noise=true , address=104.36.82.44:4893 , piece_id=MIU4ES7WPUANJMX35VSEB66TCF23EQM5257W2DX6PP6MXZPPZ2LA, seg_pos={0 0}, upload=15481]: Uploading piece... Aug 29 07:52:04.348437826 (14h59m18.340473249s) [noise=true , address=77.90.31.15:4716 , piece_id=3RIQEZ34PPZ6ENPV4LXWJIOGGDRRBHIDY7E6WARNYQKW2HUWQSAA, seg_pos={0 0}, upload=15481]: Uploading piece... Aug 29 07:52:04.348737189 (14h59m18.340772612s) [noise=true , address=104.36.82.48:4597 , piece_id=HNQ5OUATVS7HUJX34EMBSDOVPICKJEHQMY5KG2M4MUHF64L3OH6Q, seg_pos={0 0}, upload=15481]: Uploading piece... Aug 29 07:52:04.349049236 (14h59m18.341084669s) [noise=true , address=77.90.31.19:4860 , piece_id=GMRDT6ELOIYAXNDFBRIAAKRREW3KB53BW2QKQ2D3A2KHA6XKBWTQ, seg_pos={0 0}, upload=15481]: Uploading piece... Aug 29 07:52:04.349232256 (14h59m18.341267689s) [noise=true , address=77.90.31.11:4563 , piece_id=5JYMBS6CR35AOK4JCIXQLRNBKTKYZ2GZVVTIUJUYKVQLYD7N26LQ, seg_pos={0 0}, upload=15481]: Uploading piece... Aug 29 07:52:05.462822835 (14h59m19.454858258s) [upload=15481]: Next returned nil segment Aug 29 07:52:05.462840759 (14h59m19.454876192s) [upload=15481]: Waiting for error group managing segments... Aug 29 07:52:05.744472356 (14h59m19.736507779s) [noise=true , address=79.127.205.245:4251 , piece_id=J7EZRGNUJQY5APHOIFPXCP7L5MFLW62TOYOENL4AKS2JEOPNS4WQ, seg_pos={0 0}, upload=15481]: Done uploading piece. err: <nil> Aug 29 07:52:06.214177373 (14h59m20.206212796s) [noise=true , address=79.127.219.51:4212 , piece_id=UWVO5IUBQDKNHT6FFIGRDNYH32K6R436HSKUIPLKBON2KG7XQLTA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: <nil> Aug 29 07:52:06.306022534 (14h59m20.298057957s) [noise=true , address=77.90.31.13:4629 , piece_id=6ZRKDWOA5GJLDWA3AWAQMDYNGN2KM4UIUN7H6DP4ZCMIA6AWE63A, seg_pos={0 0}, upload=15481]: Done uploading piece. err: <nil> Aug 29 07:52:06.416906264 (14h59m20.408941687s) [noise=true , address=77.90.31.18:4809 , piece_id=DK5LDHUGCQI724H5DQEBTH7NLQPY3XUHVZZK6HCPUYHHHH4CORLA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: <nil> Aug 29 07:52:06.543320752 (14h59m20.535356175s) [noise=true , address=77.90.31.11:4563 , piece_id=5JYMBS6CR35AOK4JCIXQLRNBKTKYZ2GZVVTIUJUYKVQLYD7N26LQ, seg_pos={0 0}, upload=15481]: Done uploading piece. err: <nil> Aug 29 07:52:09.027730924 (14h59m23.019766347s) [noise=true , address=77.90.31.21:4880 , piece_id=AATTRCTYYNUTU4OGQUVI6RZ3EFW7S6HGRJ2DVXZ3FWMRZBQ2FTGQ, seg_pos={0 0}, upload=15481]: Done uploading piece. err: <nil> Aug 29 07:52:14.562633463 (14h59m28.554668886s) [noise=true , address=45.91.116.14:4204 , piece_id=EWRQGP4SB6AAAX4EGITMLEH4AACCBCLV7SHWCJJ5V63HKZN6HYZA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: <nil> Aug 29 07:53:03.101406830 (15h0m17.093442253s) [noise=true , address=104.36.82.44:4893 , piece_id=MIU4ES7WPUANJMX35VSEB66TCF23EQM5257W2DX6PP6MXZPPZ2LA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ, address:104.36.82.44:4893): protocol: write tcp 188.166.225.170:49736->104.36.82.44:4893: use of closed network connection; write tcp 188.166.225.170:49736->104.36.82.44:4893: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49736->104.36.82.44:4893: use of closed network connection Aug 29 07:53:03.101529706 (15h0m17.093565129s) [noise=true , address=77.90.31.12:4617 , piece_id=ZVFXNU5YOCIIP7K3LUTUMFJWBSDMUXCPZSBPIQPCKNJ55HVAYJNA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:1PpGinvTbgS3cMHoLaMhhyab7L3urApr3DJRJG4SMzWqw8UAPg, address:77.90.31.12:4617): protocol: write tcp 188.166.225.170:49950->77.90.31.12:4617: use of closed network connection; write tcp 188.166.225.170:49950->77.90.31.12:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49950->77.90.31.12:4617: use of closed network connection Aug 29 07:53:03.101619016 (15h0m17.093654439s) [noise=true , address=77.90.31.17:4802 , piece_id=D5EOFOLKVCT55PS6C3XX7IZ3SWV45TZBOVIKPE25WLPTBSKP2GIA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:12hiNtWkLwWMYr8rPN9ukEKQou5Eko2fD9ScXsqBKk5oX5wxgHy, address:77.90.31.17:4802): protocol: write tcp 188.166.225.170:33806->77.90.31.17:4802: use of closed network connection; write tcp 188.166.225.170:33806->77.90.31.17:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33806->77.90.31.17:4802: use of closed network connection Aug 29 07:53:03.101672999 (15h0m17.093708423s) [noise=true , address=104.36.82.48:4597 , piece_id=HNQ5OUATVS7HUJX34EMBSDOVPICKJEHQMY5KG2M4MUHF64L3OH6Q, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:104.36.82.48:4597): protocol: write tcp 188.166.225.170:59108->104.36.82.48:4597: use of closed network connection; write tcp 188.166.225.170:59108->104.36.82.48:4597: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59108->104.36.82.48:4597: use of closed network connection Aug 29 07:53:03.101688999 (15h0m17.093724423s) [noise=true , address=104.36.82.23:4462 , piece_id=FB44TBGJXMJNS5JVVBFDLGRYTM6O65TMCG2P5EZTHS5XJGB7X4JA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu, address:104.36.82.23:4462): protocol: write tcp 188.166.225.170:43530->104.36.82.23:4462: use of closed network connection; write tcp 188.166.225.170:43530->104.36.82.23:4462: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43530->104.36.82.23:4462: use of closed network connection Aug 29 07:53:03.101724248 (15h0m17.093759671s) [noise=true , address=104.36.82.60:4353 , piece_id=F2VW65LXBULW64ZAOI3BGEFCYXVW7YWVMLUSPVMPEIKWVZSSLSWA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ, address:104.36.82.60:4353): protocol: write tcp 188.166.225.170:36996->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:36996->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36996->104.36.82.60:4353: use of closed network connection Aug 29 07:53:03.101765907 (15h0m17.09380133s) [noise=true , address=45.91.116.4:4948 , piece_id=D6G6463FALLRH3226KWY6XMYRKZWHMK5UZXVAWS7XEX6MA73R2AQ, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:184g6qHdezLW3d2CKNW8GRgdzeVLQuMEhd8B8c1zEnkKNkeSTu, address:45.91.116.4:4948): protocol: write tcp 188.166.225.170:58784->45.91.116.4:4948: use of closed network connection; write tcp 188.166.225.170:58784->45.91.116.4:4948: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58784->45.91.116.4:4948: use of closed network connection Aug 29 07:53:03.101884234 (15h0m17.093919657s) [noise=true , address=77.90.31.19:4860 , piece_id=GMRDT6ELOIYAXNDFBRIAAKRREW3KB53BW2QKQ2D3A2KHA6XKBWTQ, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd, address:77.90.31.19:4860): protocol: write tcp 188.166.225.170:41756->77.90.31.19:4860: use of closed network connection; write tcp 188.166.225.170:41756->77.90.31.19:4860: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41756->77.90.31.19:4860: use of closed network connection Aug 29 07:53:03.101947435 (15h0m17.093982858s) [noise=true , address=77.90.31.15:4716 , piece_id=3RIQEZ34PPZ6ENPV4LXWJIOGGDRRBHIDY7E6WARNYQKW2HUWQSAA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:12tuEGhEzrpo1eV7v2QatHXHMy7b1S5gcVSymWYWJSoCFUMGnaL, address:77.90.31.15:4716): protocol: read tcp 188.166.225.170:47782->77.90.31.15:4716: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:53:03.101975138 (15h0m17.094010561s) [noise=true , address=64.49.13.140:4508 , piece_id=RD5Y4PE2CACRDEGCQDGPCHPMHOFXXOXTATQMTM53DLENQHNKGXUA, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR, address:64.49.13.140:4508): protocol: write tcp 188.166.225.170:48554->64.49.13.140:4508: use of closed network connection; write tcp 188.166.225.170:48554->64.49.13.140:4508: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48554->64.49.13.140:4508: use of closed network connection Aug 29 07:53:03.102076021 (15h0m17.094111444s) [noise=true , address=104.36.82.39:4740 , piece_id=FRV2GWL63D5PPDZAGVUD3BU2Q6RWAA6EP5GNUX5UHAIAGI5JN72Q, seg_pos={0 0}, upload=15481]: Done uploading piece. err: ecclient: upload failed (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq, address:104.36.82.39:4740): protocol: write tcp 188.166.225.170:41218->104.36.82.39:4740: use of closed network connection; write tcp 188.166.225.170:41218->104.36.82.39:4740: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41218->104.36.82.39:4740: use of closed network connection Aug 29 07:53:03.102110286 (15h0m17.094145709s) [seg_pos={0 0}, upload=15481]: Done waiting for segment. successful: 7 optimal: 14 errs: <nil> Aug 29 07:53:03.361501919 (15h0m17.353537342s) [upload=15481]: Done uploading segments... Aug 29 07:53:03.361535083 (15h0m17.353570506s) [upload=15481]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 7) Duration: 1m0.261686993s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 363.728396ms remote: "tcp:13.203.125.58:443" response headers: Vary=Accept-Encoding X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:52:56 GMT Content-Type=text/html X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=7OD58aPjiVjxHKB7v0DqEt52iEkS8V7sUR6upnTF71M-1756453976853-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT Surrogate-Control=max-age=2147483647 Age=218229 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Cf-Ray=976a78cb1d3a445b-BOM Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT target: https://www.storj.io/ FAIL (2025-08-29 07:52:56 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 363.752191ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 881.100662ms remote: "tcp:13.203.125.58:443" response headers: Date=Fri, 29 Aug 2025 07:52:47 GMT Location=https://static.storj.io/dcs-satellites Cf-Ray=976a788f4d062e2e-BOM Cf-Cache-Status=BYPASS Vary=Accept-Encoding Set-Cookie=_cfuvid=r.LPV3cCVQTv7h4v1w3vviq7e8NRQyF2XGnSqZgS0fI-1756453967634-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html Content-Length=166 Cache-Control=private X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:52:47 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 881.125418ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 23 out of 60 is failed (threshold=3) [.............................XX........XXXXXXXXXXXXXXXXXXXXX] duration: 1m0.253700876s FAIL (2025-08-29 07:52:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 4) ======LOGS====== Aug 29 07:51:36.230527242 (14h58m50.222562655s) [upload=15478]: Starting upload Aug 29 07:51:36.230599349 (14h58m50.222634772s) [upload=15478]: Done starting upload Aug 29 07:51:36.230708778 (14h58m50.222744201s) [upload=15478]: Uploading segments... Aug 29 07:51:36.230811605 (14h58m50.222847028s) [upload=15478]: Got next segment. Inline: false Aug 29 07:51:36.230852855 (14h58m50.222888278s) [upload=15478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:51:36.230857984 (14h58m50.222893407s) [upload=15478]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:51:36.805387597 (14h58m50.79742302s) [seg_pos={0 0}, upload=15478]: Begin upload segment... Aug 29 07:51:36.805439476 (14h58m50.797474889s) [seg_pos={0 0}, upload=15478]: Done begin upload segment. Aug 29 07:51:36.805489352 (14h58m50.797524775s) [noise=true , address=77.90.31.12:4598 , piece_id=22CMEQIFJEO5G25UEREHFHS3L6KWX6CYPYI23IRMCILFWT7IREFA, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.805494522 (14h58m50.797529945s) [noise=true , address=79.127.205.245:4226 , piece_id=WEK5TGAC3S2WJESIAH7T6B5RJ4GLUWT362ZR7MKRC34SQ7CL5WZA, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.805961335 (14h58m50.797996758s) [noise=true , address=104.36.82.44:4901 , piece_id=NL2V52UYQ46X6TMWYGA7M56KSKMNM5ILEZXXYC4X2CNT4MJ4BUCQ, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.805981253 (14h58m50.798016676s) [noise=true , address=77.90.31.21:4895 , piece_id=CJFEAWYI2DK2NUF7A6OQ3NOQVYLETW3UVFJS5T73WDT5W4FNHY5A, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.806344237 (14h58m50.79837966s) [noise=true , address=77.90.31.17:4769 , piece_id=ZIR37QDTBD7LGHAJSLPQHGBZAYFT25P267IWPQWXZTDKULSKJ4HQ, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.806389915 (14h58m50.798425338s) [noise=true , address=45.91.116.5:4320 , piece_id=VBY2ABINXKI6JAI6VM2CAP7MMUOAHVCF6DI4GIK7LRLX4FYBM66Q, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.806610046 (14h58m50.798645469s) [noise=true , address=64.49.13.26:4954 , piece_id=5RQTSWF6STTMTTEMXOO2MRQJSISWQQTYQCXGUSPXGWBEHB4PHEGA, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.807076679 (14h58m50.799112102s) [noise=true , address=77.90.31.10:4534 , piece_id=5ALGJJ74SL2NY2PGQ6U4G4XEA446QUXJPR3OJALZMWSU4EPNRICQ, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.807545336 (14h58m50.799580759s) [noise=true , address=45.91.116.9:4287 , piece_id=BYOZIO3DJZVZXMNVKL3FPNG6O63RXBFKZKN5U734DWTKUQIRNHAQ, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.808281755 (14h58m50.800317178s) [noise=true , address=104.36.82.60:4368 , piece_id=IXBD6XIDJIUZ3AEBM25BCYVU5UTVBY37Z33JLL2VCTN3BIU2S5KQ, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.808712900 (14h58m50.800748323s) [noise=true , address=77.90.31.16:4754 , piece_id=OVIG5CD4KOIUEYU6AWEF3IW6RE7DUMS66JBVK7IMWIU5PN6GAZFA, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.809053632 (14h58m50.801089055s) [noise=true , address=77.90.31.15:4732 , piece_id=ETAE7B34H3QANDER5SVPSSWACO5UWCJTL2NVP4EPO7XZZF7SJCSQ, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.810171902 (14h58m50.802207325s) [noise=true , address=104.36.82.5:4848 , piece_id=6C7RJZKDGLXVRY2WI3YSU5SF7ZW2WJTT2EAIUQPTLMZOHWAGPF7Q, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.811126398 (14h58m50.803161821s) [noise=true , address=77.90.31.18:4835 , piece_id=XNLWWVUTKARLZJ6UXKXMHLSPVZUKRF6KVMWIIJWMCT7ZHCYBQI4Q, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.811420891 (14h58m50.803456314s) [noise=true , address=64.49.13.138:4483 , piece_id=5WUQFVBS37SZVWNKZ3VRQ5FSV6RPZZSR2EWLSBQRMNBIV6O7HHNA, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.811698813 (14h58m50.803734236s) [noise=true , address=104.36.82.44:4903 , piece_id=CUVPZ3SOV2KPFNRAUU4WTNW3WTEX7S6CLTF7HKLTA2YG5HLIVG6Q, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.811909676 (14h58m50.803945099s) [noise=true , address=79.127.205.246:4278 , piece_id=E2AWHWNBEGMT2G4VEN5YOJXJICUATJD3YR4A7SPAAZB4H3QJCZIA, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:36.812108396 (14h58m50.804143819s) [noise=true , address=79.127.219.48:4101 , piece_id=NDNDGYECU4GOBRPLZMPCZTOJ2PBHVTYMW4Y2Z5DMAQOTQLMJ3BMQ, seg_pos={0 0}, upload=15478]: Uploading piece... Aug 29 07:51:37.954466281 (14h58m51.946501704s) [upload=15478]: Next returned nil segment Aug 29 07:51:37.954490336 (14h58m51.946525749s) [upload=15478]: Waiting for error group managing segments... Aug 29 07:51:38.245908400 (14h58m52.237943823s) [noise=true , address=79.127.205.245:4226 , piece_id=WEK5TGAC3S2WJESIAH7T6B5RJ4GLUWT362ZR7MKRC34SQ7CL5WZA, seg_pos={0 0}, upload=15478]: Done uploading piece. err: <nil> Aug 29 07:51:38.266936326 (14h58m52.258971749s) [noise=true , address=79.127.205.246:4278 , piece_id=E2AWHWNBEGMT2G4VEN5YOJXJICUATJD3YR4A7SPAAZB4H3QJCZIA, seg_pos={0 0}, upload=15478]: Done uploading piece. err: <nil> Aug 29 07:51:38.739625864 (14h58m52.731661287s) [noise=true , address=79.127.219.48:4101 , piece_id=NDNDGYECU4GOBRPLZMPCZTOJ2PBHVTYMW4Y2Z5DMAQOTQLMJ3BMQ, seg_pos={0 0}, upload=15478]: Done uploading piece. err: <nil> Aug 29 07:51:38.811583441 (14h58m52.803618884s) [noise=true , address=77.90.31.10:4534 , piece_id=5ALGJJ74SL2NY2PGQ6U4G4XEA446QUXJPR3OJALZMWSU4EPNRICQ, seg_pos={0 0}, upload=15478]: Done uploading piece. err: <nil> Aug 29 07:52:35.510128917 (14h59m49.50216434s) [noise=true , address=77.90.31.18:4835 , piece_id=XNLWWVUTKARLZJ6UXKXMHLSPVZUKRF6KVMWIIJWMCT7ZHCYBQI4Q, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12hAQp2Zr7WSaQSTCZf5pwSyuBHHSrZWq5EVz5hFvSA5ddWebqg, address:77.90.31.18:4835): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 07:52:35.510800162 (14h59m49.502835585s) [noise=true , address=77.90.31.17:4769 , piece_id=ZIR37QDTBD7LGHAJSLPQHGBZAYFT25P267IWPQWXZTDKULSKJ4HQ, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd, address:77.90.31.17:4769): protocol: write tcp 188.166.225.170:43240->77.90.31.17:4769: use of closed network connection; write tcp 188.166.225.170:43240->77.90.31.17:4769: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43240->77.90.31.17:4769: use of closed network connection Aug 29 07:52:35.510853804 (14h59m49.502889227s) [noise=true , address=77.90.31.16:4754 , piece_id=OVIG5CD4KOIUEYU6AWEF3IW6RE7DUMS66JBVK7IMWIU5PN6GAZFA, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12KKCnEfLWFbLY7ViZ8uzgKfNDeVby4XaoRiBKiQCH39mq82RJ8, address:77.90.31.16:4754): protocol: write tcp 188.166.225.170:43748->77.90.31.16:4754: use of closed network connection; write tcp 188.166.225.170:43748->77.90.31.16:4754: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43748->77.90.31.16:4754: use of closed network connection Aug 29 07:52:35.510890685 (14h59m49.502926108s) [noise=true , address=104.36.82.5:4848 , piece_id=6C7RJZKDGLXVRY2WI3YSU5SF7ZW2WJTT2EAIUQPTLMZOHWAGPF7Q, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp, address:104.36.82.5:4848): protocol: write tcp 188.166.225.170:36470->104.36.82.5:4848: use of closed network connection; write tcp 188.166.225.170:36470->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36470->104.36.82.5:4848: use of closed network connection Aug 29 07:52:35.510926303 (14h59m49.502961726s) [noise=true , address=77.90.31.12:4598 , piece_id=22CMEQIFJEO5G25UEREHFHS3L6KWX6CYPYI23IRMCILFWT7IREFA, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12Li7UVDCVmainU4mkxtFyGky2wi6989Qu12BCQGgNn6roNX2A3, address:77.90.31.12:4598): protocol: rpc: dial tcp 77.90.31.12:4598: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:52:35.511049429 (14h59m49.503084852s) [noise=true , address=45.91.116.5:4320 , piece_id=VBY2ABINXKI6JAI6VM2CAP7MMUOAHVCF6DI4GIK7LRLX4FYBM66Q, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12iDqXUpUqsDwhzKGNY1kMqEhS6vbHiESooVR9xu92B3SGybNmn, address:45.91.116.5:4320): protocol: write tcp 188.166.225.170:54312->45.91.116.5:4320: use of closed network connection; write tcp 188.166.225.170:54312->45.91.116.5:4320: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54312->45.91.116.5:4320: use of closed network connection Aug 29 07:52:35.511153657 (14h59m49.50318908s) [noise=true , address=77.90.31.15:4732 , piece_id=ETAE7B34H3QANDER5SVPSSWACO5UWCJTL2NVP4EPO7XZZF7SJCSQ, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH, address:77.90.31.15:4732): protocol: write tcp 188.166.225.170:56156->77.90.31.15:4732: use of closed network connection; write tcp 188.166.225.170:56156->77.90.31.15:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->77.90.31.15:4732: use of closed network connection Aug 29 07:52:35.511186912 (14h59m49.503222335s) [noise=true , address=64.49.13.138:4483 , piece_id=5WUQFVBS37SZVWNKZ3VRQ5FSV6RPZZSR2EWLSBQRMNBIV6O7HHNA, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12Bq23DceaRvomaGDHoZr3sYzSHHJEQr2wE4LzSEYk9rUm1DhLa, address:64.49.13.138:4483): protocol: write tcp 188.166.225.170:57344->64.49.13.138:4483: use of closed network connection; write tcp 188.166.225.170:57344->64.49.13.138:4483: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57344->64.49.13.138:4483: use of closed network connection Aug 29 07:52:35.511230354 (14h59m49.503265777s) [noise=true , address=104.36.82.44:4903 , piece_id=CUVPZ3SOV2KPFNRAUU4WTNW3WTEX7S6CLTF7HKLTA2YG5HLIVG6Q, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq, address:104.36.82.44:4903): protocol: write tcp 188.166.225.170:51642->104.36.82.44:4903: use of closed network connection; write tcp 188.166.225.170:51642->104.36.82.44:4903: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51642->104.36.82.44:4903: use of closed network connection Aug 29 07:52:35.511265922 (14h59m49.503301335s) [noise=true , address=77.90.31.21:4895 , piece_id=CJFEAWYI2DK2NUF7A6OQ3NOQVYLETW3UVFJS5T73WDT5W4FNHY5A, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: write tcp 188.166.225.170:49696->77.90.31.21:4895: use of closed network connection; write tcp 188.166.225.170:49696->77.90.31.21:4895: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49696->77.90.31.21:4895: use of closed network connection Aug 29 07:52:35.511297123 (14h59m49.503332546s) [noise=true , address=45.91.116.9:4287 , piece_id=BYOZIO3DJZVZXMNVKL3FPNG6O63RXBFKZKN5U734DWTKUQIRNHAQ, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf, address:45.91.116.9:4287): protocol: write tcp 188.166.225.170:52566->45.91.116.9:4287: use of closed network connection; write tcp 188.166.225.170:52566->45.91.116.9:4287: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52566->45.91.116.9:4287: use of closed network connection Aug 29 07:52:35.511339613 (14h59m49.503375036s) [noise=true , address=104.36.82.60:4368 , piece_id=IXBD6XIDJIUZ3AEBM25BCYVU5UTVBY37Z33JLL2VCTN3BIU2S5KQ, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB, address:104.36.82.60:4368): protocol: write tcp 188.166.225.170:54026->104.36.82.60:4368: use of closed network connection; write tcp 188.166.225.170:54026->104.36.82.60:4368: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54026->104.36.82.60:4368: use of closed network connection Aug 29 07:52:35.511370572 (14h59m49.503405996s) [noise=true , address=104.36.82.44:4901 , piece_id=NL2V52UYQ46X6TMWYGA7M56KSKMNM5ILEZXXYC4X2CNT4MJ4BUCQ, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1, address:104.36.82.44:4901): protocol: read tcp 188.166.225.170:51352->104.36.82.44:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:52:35.511399858 (14h59m49.503435281s) [noise=true , address=64.49.13.26:4954 , piece_id=5RQTSWF6STTMTTEMXOO2MRQJSISWQQTYQCXGUSPXGWBEHB4PHEGA, seg_pos={0 0}, upload=15478]: Done uploading piece. err: ecclient: upload failed (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo, address:64.49.13.26:4954): protocol: read tcp 188.166.225.170:53486->64.49.13.26:4954: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:52:35.511423474 (14h59m49.503458897s) [seg_pos={0 0}, upload=15478]: Done waiting for segment. successful: 4 optimal: 14 errs: <nil> Aug 29 07:52:35.762551425 (14h59m49.754586958s) [upload=15478]: Done uploading segments... Aug 29 07:52:35.762629153 (14h59m49.754664667s) [upload=15478]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 4) Duration: 1m0.253713609s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [.......................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.252223554s FAIL (2025-08-29 07:52:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.393545432 (14h59m8.385580855s) [noise=true , address=77.90.31.18:4807 , piece_id=GB7YTNRFUDIOFCIQRDZ3G3GGQ5GLTAJIMPVKQERQW74EIXZGHLGQ, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.393721939 (14h59m8.385757363s) [noise=true , address=104.36.82.4:4804 , piece_id=FZIJEDGHROXPEW5MG3TWVXWQDOMGRWAAKE6VWM4PQBZX3RSTS3WA, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.393838162 (14h59m8.385873595s) [noise=true , address=45.91.116.5:4299 , piece_id=UB6KFZOAWU6PV35VJPYIOETGSP3HDLK6CJ4MUCMPPZSO2MQ6SH6Q, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.394110713 (14h59m8.386146136s) [noise=true , address=45.91.116.5:4298 , piece_id=MUWT7WNDHHPEA5F6SKFHDKEV24R55XUNWO5GKQC5FEIWEEDXCB2Q, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.394430125 (14h59m8.386465548s) [noise=true , address=77.90.31.18:4806 , piece_id=3ZWDO435AIWZXZ44R7AGJSLASZFFNFVE3LIAZVGRQO6BFMGK4IQA, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.394772580 (14h59m8.386808014s) [noise=true , address=104.36.82.13:4185 , piece_id=EAO2X5BJT6RZS236WXTHZYVYXLD64R7DQX3THNL7IM26DRW3EGFA, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.395153840 (14h59m8.387189253s) [noise=true , address=45.91.116.6:4974 , piece_id=JVEN7WYXOTWJLMAG4BG47RIQR7ZWNN44UGEVBG43CFIJLYQ4JOJQ, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.395492668 (14h59m8.387528091s) [noise=true , address=45.91.116.12:4226 , piece_id=7WM6XSNDOL5ARNPBGR5GOIFCJX4NJTJ2TW2ZY6HX3IYVXRV7ORJA, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.395813312 (14h59m8.387848735s) [noise=true , address=45.91.116.11:4119 , piece_id=MUPLWIW7HYIRR4CZ3A3SUQVZDKHOGDRRPWSZCPOY5EF5AOC3NMBA, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:54.396144856 (14h59m8.388180279s) [noise=true , address=77.90.31.16:4735 , piece_id=VJ33RYF3IZSY7UER2KYD5ZTWYVU355PMJOWIKY7JQ5OOQ6IE2DUA, seg_pos={0 0}, upload=15480]: Uploading piece... Aug 29 07:51:56.273526109 (14h59m10.265561532s) [upload=15480]: Next returned nil segment Aug 29 07:51:56.273548291 (14h59m10.265583714s) [upload=15480]: Waiting for error group managing segments... Aug 29 07:51:56.561274480 (14h59m10.553309903s) [noise=true , address=77.90.31.18:4807 , piece_id=GB7YTNRFUDIOFCIQRDZ3G3GGQ5GLTAJIMPVKQERQW74EIXZGHLGQ, seg_pos={0 0}, upload=15480]: Done uploading piece. err: <nil> Aug 29 07:51:56.661329221 (14h59m10.653364644s) [noise=true , address=45.91.116.11:4119 , piece_id=MUPLWIW7HYIRR4CZ3A3SUQVZDKHOGDRRPWSZCPOY5EF5AOC3NMBA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: <nil> Aug 29 07:51:56.685123600 (14h59m10.677159023s) [noise=true , address=45.91.116.10:4081 , piece_id=QEN7WE65W5HB5YNXWHID4ES2JD7DNAROQU5LE3Z5TI54B3BFGCWQ, seg_pos={0 0}, upload=15480]: Done uploading piece. err: <nil> Aug 29 07:51:59.113893378 (14h59m13.105928811s) [noise=true , address=45.91.116.10:4082 , piece_id=FFY663NBD33C6HWHBGWXEQMTKK3H63SE3LCTHCCX2XSG2LRU435Q, seg_pos={0 0}, upload=15480]: Done uploading piece. err: <nil> Aug 29 07:52:03.284286916 (14h59m17.276322339s) [noise=true , address=77.90.31.18:4806 , piece_id=3ZWDO435AIWZXZ44R7AGJSLASZFFNFVE3LIAZVGRQO6BFMGK4IQA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: <nil> Aug 29 07:52:23.417623621 (14h59m37.409659034s) [noise=true , address=45.91.116.6:4974 , piece_id=JVEN7WYXOTWJLMAG4BG47RIQR7ZWNN44UGEVBG43CFIJLYQ4JOJQ, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:35966->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:35966->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35966->45.91.116.6:4974: use of closed network connection Aug 29 07:52:23.417686782 (14h59m37.409722205s) [noise=true , address=104.36.82.4:4804 , piece_id=FZIJEDGHROXPEW5MG3TWVXWQDOMGRWAAKE6VWM4PQBZX3RSTS3WA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: write tcp 188.166.225.170:53860->104.36.82.4:4804: use of closed network connection; write tcp 188.166.225.170:53860->104.36.82.4:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53860->104.36.82.4:4804: use of closed network connection Aug 29 07:52:23.417742699 (14h59m37.409778122s) [noise=true , address=45.91.116.5:4299 , piece_id=UB6KFZOAWU6PV35VJPYIOETGSP3HDLK6CJ4MUCMPPZSO2MQ6SH6Q, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44344->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44344->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44344->45.91.116.5:4299: use of closed network connection Aug 29 07:52:23.417878699 (14h59m37.409914122s) [noise=true , address=77.90.31.11:4555 , piece_id=3QF3BXD3QQHCKU7K56L4DJPXDG2R5EKXA6666KXBL2YLE6OCRE3Q, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:37450->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37450->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37450->77.90.31.11:4555: use of closed network connection Aug 29 07:52:23.417944916 (14h59m37.40998034s) [noise=true , address=77.90.31.16:4735 , piece_id=VJ33RYF3IZSY7UER2KYD5ZTWYVU355PMJOWIKY7JQ5OOQ6IE2DUA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:54348->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:54348->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54348->77.90.31.16:4735: use of closed network connection Aug 29 07:52:23.417984201 (14h59m37.410019624s) [noise=true , address=45.91.116.12:4225 , piece_id=MBIVR7Q22WMDMZRAJWBMMB57BJ42IIAOWZCWRNRBTKHWKAPIRGDA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 188.166.225.170:46046->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:52:23.418044286 (14h59m37.410079709s) [noise=true , address=45.91.116.12:4226 , piece_id=7WM6XSNDOL5ARNPBGR5GOIFCJX4NJTJ2TW2ZY6HX3IYVXRV7ORJA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 188.166.225.170:37332->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:52:23.418051780 (14h59m37.410087203s) [noise=true , address=104.36.82.8:4970 , piece_id=5IGVUR6JRRDEZVUYUABZN6JPUL3N6O5D5BSTCSUXLIABGX5QQD6Q, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:104.36.82.8:4970): protocol: write tcp 188.166.225.170:48406->104.36.82.8:4970: use of closed network connection; write tcp 188.166.225.170:48406->104.36.82.8:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48406->104.36.82.8:4970: use of closed network connection Aug 29 07:52:23.418096165 (14h59m37.410131588s) [noise=true , address=45.91.116.4:4937 , piece_id=Y4PAJPJVKW6S7RFTNVL2254ZC4LRPBL4LZ7NYVQNUXBOKSSOR7QA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 188.166.225.170:55308->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:55308->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55308->45.91.116.4:4937: use of closed network connection Aug 29 07:52:23.418106525 (14h59m37.410141948s) [noise=true , address=45.91.116.5:4298 , piece_id=MUWT7WNDHHPEA5F6SKFHDKEV24R55XUNWO5GKQC5FEIWEEDXCB2Q, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 188.166.225.170:40956->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:52:23.418138016 (14h59m37.410173439s) [noise=true , address=104.36.82.13:4185 , piece_id=EAO2X5BJT6RZS236WXTHZYVYXLD64R7DQX3THNL7IM26DRW3EGFA, seg_pos={0 0}, upload=15480]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: read tcp 188.166.225.170:51722->104.36.82.13:4185: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:52:23.418164416 (14h59m37.410199829s) [seg_pos={0 0}, upload=15480]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Aug 29 07:52:23.668414426 (14h59m37.66044985s) [upload=15480]: Done uploading segments... Aug 29 07:52:23.668439024 (14h59m37.660474447s) [upload=15480]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 30.252252919s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 370.668295ms remote: "tcp:13.233.175.166:443" response headers: Cf-Ray=976a77f02f8348d7-BOM Cf-Cache-Status=HIT Age=218194 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Set-Cookie=_cfuvid=4YcKJri1uEo.B8l5iETXRtLB2z1MWDo7GnNc_t4JP5A-1756453941828-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 07:52:21 GMT Content-Type=text/html Surrogate-Control=max-age=2147483647 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/ FAIL (2025-08-29 07:52:21 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 370.695969ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 22 out of 60 is failed (threshold=3) [...............................XX.......XXXXXXXXXXXXXXXXXXXX] duration: 1m0.258725944s FAIL (2025-08-29 07:52:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== 5QINDDG24LSSBDPVVCO2DALNOEEKMRA, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.819729923 (14h58m17.811765346s) [noise=true , address=77.90.31.21:4895 , piece_id=JGDE3QUIP57DWO2NJZS5NKDVNRECZF2CYS5WFDBWBML7X64DMFEQ, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.819851797 (14h58m17.81188722s) [noise=true , address=104.36.82.23:4462 , piece_id=3P4PSLG6RSD7IUWSJFG2OFXJK67AI3AQGZU4JJ2PYMVGGWVUSQZA, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.820057730 (14h58m17.812093153s) [noise=true , address=77.90.31.16:4743 , piece_id=AM3XIDIBCPMAUX4LC4FE3BGVN2UYD2SWXTEMWVIQEOTLRJRCFHWQ, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.820148685 (14h58m17.812184108s) [noise=true , address=104.36.82.53:4155 , piece_id=BIVDYQIRDRMCS4CFF2CA4OOXPLF2GZ34I5U75UOIMLWOJAULLUDQ, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.820261110 (14h58m17.812296533s) [noise=true , address=77.90.31.17:4795 , piece_id=I3Q3DXKQ7XZ3AI67XQIZJEZLOWKGPWDCPJG4YSHBSWEQLKFKMCCA, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.820464559 (14h58m17.812499982s) [noise=true , address=77.90.31.14:4672 , piece_id=H6N2HUELXBAWXKYPZMSNJRQODONKB24RG7KG74WDKXHTDB7OOE5Q, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.820500247 (14h58m17.81253567s) [noise=true , address=64.49.13.140:4508 , piece_id=IWCQMNIDLSMQVDQFDZPHSJB6IJYPRKDHZXE6S4MRLBHPU3BDLNJQ, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:03.820852010 (14h58m17.812887433s) [noise=true , address=64.49.13.138:4482 , piece_id=X5HGAF4H3MM4BP3IKDO5JTUPYSRNTYHI6MHB5DSCKVI5VXSS3HHA, seg_pos={0 0}, upload=15465]: Uploading piece... Aug 29 07:51:05.040107073 (14h58m19.032142496s) [upload=15465]: Next returned nil segment Aug 29 07:51:05.040125217 (14h58m19.03216064s) [upload=15465]: Waiting for error group managing segments... Aug 29 07:51:05.351627802 (14h58m19.343663225s) [noise=true , address=64.49.13.140:4508 , piece_id=IWCQMNIDLSMQVDQFDZPHSJB6IJYPRKDHZXE6S4MRLBHPU3BDLNJQ, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:51:05.793937749 (14h58m19.785973172s) [noise=true , address=77.90.31.13:4638 , piece_id=JTWZSQFMUHSU7ASSBWQWT2ONTBGR6INTLUBFB5ELTEZFUS62MJCA, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:51:05.819938379 (14h58m19.811973802s) [noise=true , address=156.146.43.225:4445 , piece_id=Z5NAJIDLMTN5UOCOQPL6X2NWZJI2QGXBVE2NIHP6HBYITJY7HQVA, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:51:05.860280232 (14h58m19.852315655s) [noise=true , address=77.90.31.14:4672 , piece_id=H6N2HUELXBAWXKYPZMSNJRQODONKB24RG7KG74WDKXHTDB7OOE5Q, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:51:05.980577183 (14h58m19.972612606s) [noise=true , address=104.36.82.60:4353 , piece_id=UOBV7RGMETBI463MG7OFHAUXO74RMRPUSQMDYOSS4QAKOFCH7YRQ, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:51:05.988843461 (14h58m19.980878884s) [noise=true , address=104.36.82.54:4172 , piece_id=MB73B2P7U5GDQCFLYIPCG5YJINIDC26VSW5AE3233LM6ADW6YNUA, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:51:10.091051698 (14h58m24.083087121s) [noise=true , address=77.90.31.15:4703 , piece_id=JSMMZHGF5BQSXD2OYRKHE7FVV547EN6FLTDQXBN7WDOHNVI73E4Q, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:51:14.367512521 (14h58m28.359547944s) [noise=true , address=45.91.116.8:4061 , piece_id=L6XJRAJDUKHDWZZZFARQLHX3WRM75QNUOTTVJ6A3Z2NO77JHWF4A, seg_pos={0 0}, upload=15465]: Done uploading piece. err: <nil> Aug 29 07:52:02.594265934 (14h59m16.586301357s) [noise=true , address=104.36.82.48:4597 , piece_id=6DY3W5VI4YIVPSWJNJJELYKVGL6A5IVYL74SHPVM2TGAHKW4ZI3A, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:104.36.82.48:4597): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 07:52:02.594417884 (14h59m16.586453307s) [noise=true , address=64.49.13.138:4482 , piece_id=X5HGAF4H3MM4BP3IKDO5JTUPYSRNTYHI6MHB5DSCKVI5VXSS3HHA, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:12joW2m4Uc87FSH65Cep1UKivUB1HG1119CQj14eWEKPcwaPsD5, address:64.49.13.138:4482): protocol: write tcp 188.166.225.170:54140->64.49.13.138:4482: use of closed network connection; write tcp 188.166.225.170:54140->64.49.13.138:4482: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54140->64.49.13.138:4482: use of closed network connection Aug 29 07:52:02.594448764 (14h59m16.586484187s) [noise=true , address=77.90.31.17:4795 , piece_id=I3Q3DXKQ7XZ3AI67XQIZJEZLOWKGPWDCPJG4YSHBSWEQLKFKMCCA, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:1mxsUnqqgD1WuDixAq7bcMiQb6JzmC4seq8s2YXY7HjvgKCkGt, address:77.90.31.17:4795): protocol: write tcp 188.166.225.170:53858->77.90.31.17:4795: use of closed network connection; write tcp 188.166.225.170:53858->77.90.31.17:4795: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53858->77.90.31.17:4795: use of closed network connection Aug 29 07:52:02.594498909 (14h59m16.586534342s) [noise=true , address=45.91.116.6:4999 , piece_id=7ODTNF674ESV7YFLWLZYBYCJVFHQC2G22JQXNKA5XPE2UIPCY4XQ, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB, address:45.91.116.6:4999): protocol: write tcp 188.166.225.170:33344->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:33344->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->45.91.116.6:4999: use of closed network connection Aug 29 07:52:02.594544647 (14h59m16.58658007s) [noise=true , address=77.90.31.16:4743 , piece_id=AM3XIDIBCPMAUX4LC4FE3BGVN2UYD2SWXTEMWVIQEOTLRJRCFHWQ, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:12XLPBKV4R1CLgVK32nSQffKHxjhU7XsGo8MEsHaAbDGiusTTAv, address:77.90.31.16:4743): protocol: write tcp 188.166.225.170:56882->77.90.31.16:4743: use of closed network connection; write tcp 188.166.225.170:56882->77.90.31.16:4743: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56882->77.90.31.16:4743: use of closed network connection Aug 29 07:52:02.594563123 (14h59m16.586598546s) [noise=true , address=77.90.31.21:4895 , piece_id=JGDE3QUIP57DWO2NJZS5NKDVNRECZF2CYS5WFDBWBML7X64DMFEQ, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: write tcp 188.166.225.170:41636->77.90.31.21:4895: use of closed network connection; write tcp 188.166.225.170:41636->77.90.31.21:4895: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41636->77.90.31.21:4895: use of closed network connection Aug 29 07:52:02.594595825 (14h59m16.586631248s) [noise=true , address=104.36.82.23:4462 , piece_id=3P4PSLG6RSD7IUWSJFG2OFXJK67AI3AQGZU4JJ2PYMVGGWVUSQZA, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu, address:104.36.82.23:4462): protocol: write tcp 188.166.225.170:33450->104.36.82.23:4462: use of closed network connection; write tcp 188.166.225.170:33450->104.36.82.23:4462: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33450->104.36.82.23:4462: use of closed network connection Aug 29 07:52:02.594614862 (14h59m16.586650285s) [noise=true , address=45.91.116.14:4222 , piece_id=K47A7NYN5FVKKH3MAZHE7F4XKCY7KPQUDNK222NLKS4VNQ6A5NXQ, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:1HK7tc3kteH465RN26qhUuyPL8257whn1gMiuZDDP7gPYENQA9, address:45.91.116.14:4222): protocol: write tcp 188.166.225.170:34342->45.91.116.14:4222: use of closed network connection; write tcp 188.166.225.170:34342->45.91.116.14:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34342->45.91.116.14:4222: use of closed network connection Aug 29 07:52:02.594696128 (14h59m16.586731581s) [noise=true , address=77.90.31.11:4576 , piece_id=PHA3ODDNBGB2GNVI3L5KR5QINDDG24LSSBDPVVCO2DALNOEEKMRA, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:1br8Q73A3rDz8b6fZxop71zh5vdEcdye9D7ta8aBpsctwLBfAv, address:77.90.31.11:4576): protocol: write tcp 188.166.225.170:56396->77.90.31.11:4576: use of closed network connection; write tcp 188.166.225.170:56396->77.90.31.11:4576: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56396->77.90.31.11:4576: use of closed network connection Aug 29 07:52:02.594746713 (14h59m16.586782137s) [noise=true , address=104.36.82.53:4155 , piece_id=BIVDYQIRDRMCS4CFF2CA4OOXPLF2GZ34I5U75UOIMLWOJAULLUDQ, seg_pos={0 0}, upload=15465]: Done uploading piece. err: ecclient: upload failed (node:17wRBzmgMvpNyXy9SZEwEjwc4W5TfKzTj8vaa9c2HXnPNLMMYi, address:104.36.82.53:4155): protocol: write tcp 188.166.225.170:45704->104.36.82.53:4155: use of closed network connection; write tcp 188.166.225.170:45704->104.36.82.53:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45704->104.36.82.53:4155: use of closed network connection Aug 29 07:52:02.594787843 (14h59m16.586823276s) [seg_pos={0 0}, upload=15465]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Aug 29 07:52:02.850795450 (14h59m16.842830883s) [upload=15465]: Done uploading segments... Aug 29 07:52:02.850824085 (14h59m16.842859508s) [upload=15465]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 1m0.25875044s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 637.742989ms remote: "tcp:3.109.243.18:443" response headers: Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private Cf-Ray=976a776ed83a3d2a-BOM Vary=Accept-Encoding Set-Cookie=_cfuvid=wi48w6Nz.OlfSNiPdEHvqrYhlCrZkR6c_yCTR5mvT8c-1756453921474-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:52:01 GMT Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:52:01 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 637.763298ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 631.604403ms remote: "tcp:13.203.125.58:443" response headers: Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html Cf-Ray=976a76e8fe59d85a-BOM Vary=Accept-Encoding Set-Cookie=_cfuvid=FnY2Idsw.XRXXpLXOaUJiP7dB1Hy.kMsr.B9tHzFCJo-1756453900048-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:51:40 GMT Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:51:40 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 631.627337ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 22 out of 60 is failed (threshold=3) [..............................XX........XXXXXXXXXXXXXXXXXXXX] duration: 1m0.265300221s FAIL (2025-08-29 07:51:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 29 07:50:35.717728192 (14h57m49.709763615s) [upload=15457]: Starting upload Aug 29 07:50:35.717845176 (14h57m49.709880599s) [upload=15457]: Done starting upload Aug 29 07:50:35.717958343 (14h57m49.709993766s) [upload=15457]: Uploading segments... Aug 29 07:50:35.718124120 (14h57m49.710159543s) [upload=15457]: Got next segment. Inline: false Aug 29 07:50:35.718176300 (14h57m49.710211723s) [upload=15457]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:50:35.718182772 (14h57m49.710218195s) [upload=15457]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:50:36.228049117 (14h57m50.22008454s) [seg_pos={0 0}, upload=15457]: Begin upload segment... Aug 29 07:50:36.228094053 (14h57m50.220129476s) [seg_pos={0 0}, upload=15457]: Done begin upload segment. Aug 29 07:50:36.228119482 (14h57m50.220154905s) [noise=true , address=79.127.205.246:4282 , piece_id=LQMDEYRYVSFE6C7CQQVD7QG7MNEXO4PFBFQODPZ5IMTTO5QNN4IA, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.228144360 (14h57m50.220179783s) [noise=true , address=77.90.31.19:4847 , piece_id=4Q44RIYVLK3XOINZWRTG6HUKW2BNBVZQ67RTDOIANOAB6FRKBGUQ, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.228499850 (14h57m50.220535273s) [noise=true , address=45.91.116.12:4249 , piece_id=3ODASCO6JMQPNURQLDF3XR3U7TNGRJE3WYESCOQRH4WRWC3ZKZVQ, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.228570164 (14h57m50.220605587s) [noise=true , address=79.127.219.48:4101 , piece_id=Q4ZASPXNDU5RLISZYCJIHO7COFJ6PUYJG3PX5GJISPS2DIRC7JAA, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.228814852 (14h57m50.220850275s) [noise=true , address=77.90.31.10:4521 , piece_id=JR7S7PWZEJS6LU7WNUD5NIFPISZVR6UJNXFCNTOBB4YYSVHIXA6A, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.229095639 (14h57m50.221131062s) [noise=true , address=77.90.31.18:4836 , piece_id=TMBDI4PI7PVBBU72EWXMSDBFEFEPATTIJV2WF33KLUU5FJK2SWUA, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.229438225 (14h57m50.221473648s) [noise=true , address=104.36.82.48:4582 , piece_id=R5LMSXAGIMTNKBUI3EQDCODU5VCM5YGDORIKCPBAV6SRB4H75DGA, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.229708573 (14h57m50.221743996s) [noise=true , address=77.90.31.12:4615 , piece_id=SPZA6TIOZ56L4WOKVDRI3N4NRHBCOZFE3DYBJJLPSGWMRNWOQZMQ, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.229981485 (14h57m50.222016898s) [noise=true , address=104.36.82.9:4011 , piece_id=UXTDXTQW4VWAWSQUAIV3PVGJV7CMMUVGHRGIZLUWU4EZXWXQE3VQ, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.230199502 (14h57m50.222234925s) [noise=true , address=79.127.205.245:4239 , piece_id=PDJOQ7LJ5VGJ3ZB6WUI4XD55RIWOC5QZ6E4PKHQHTFFHOFFM7H3Q, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.230411537 (14h57m50.22244698s) [noise=true , address=77.90.31.13:4637 , piece_id=VN6HWNN6XPNGDDPZVEYYR7GT5LUYBXA5XRLGMERKFP4DW4RQ7MIA, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.230755656 (14h57m50.222791079s) [noise=true , address=77.90.31.17:4787 , piece_id=TPANGYHTEUPWOPPU2TNSQRSIF7LXOFZ3ID6UXWK4WTE3OYH7LFCQ, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.231028769 (14h57m50.223064192s) [noise=true , address=77.90.31.11:4563 , piece_id=VD7Q3X2LIT3DTHNTKLRAQQCDANXLSDXVW523L5WHFWNIJSA33ANQ, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.231379169 (14h57m50.223414602s) [noise=true , address=104.36.82.23:4446 , piece_id=C3DMUXDI3TF5MFF5H2WMUHPODRU3AFAXDVOKUK6VQ72JQ5YY2M5Q, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.231663693 (14h57m50.223699116s) [noise=true , address=77.90.31.14:4695 , piece_id=JMABP7F5AO6ZI75C6XLPQ6R4U7EELZJ2RPJQ4NKCPZMQQRUYQ2EA, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.231885968 (14h57m50.223921392s) [noise=true , address=156.146.43.225:4446 , piece_id=YXML66MUNPY2KRHP64UZZU2NKRXJ4JUJDVXMCG5HBSNGSU6UOROQ, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.232155044 (14h57m50.224190467s) [noise=true , address=77.90.31.21:4896 , piece_id=DJB2ZH4LOCPESSDHZE4BQCL6ZSG26G633JDS3SO2TBVYEKTIASBA, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:36.232478753 (14h57m50.224514176s) [noise=true , address=77.90.31.16:4752 , piece_id=DQ4TSOD7YOHUHENTIXI2Q4J7HHWKG73TQBBK2ABYBUAN2AUJF67A, seg_pos={0 0}, upload=15457]: Uploading piece... Aug 29 07:50:37.375431845 (14h57m51.367467268s) [upload=15457]: Next returned nil segment Aug 29 07:50:37.375450220 (14h57m51.367485643s) [upload=15457]: Waiting for error group managing segments... Aug 29 07:50:37.667271375 (14h57m51.659306798s) [noise=true , address=79.127.205.246:4282 , piece_id=LQMDEYRYVSFE6C7CQQVD7QG7MNEXO4PFBFQODPZ5IMTTO5QNN4IA, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:37.668036168 (14h57m51.660071591s) [noise=true , address=79.127.205.245:4239 , piece_id=PDJOQ7LJ5VGJ3ZB6WUI4XD55RIWOC5QZ6E4PKHQHTFFHOFFM7H3Q, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:38.163482271 (14h57m52.155517694s) [noise=true , address=156.146.43.225:4446 , piece_id=YXML66MUNPY2KRHP64UZZU2NKRXJ4JUJDVXMCG5HBSNGSU6UOROQ, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:38.165604090 (14h57m52.157639513s) [noise=true , address=79.127.219.48:4101 , piece_id=Q4ZASPXNDU5RLISZYCJIHO7COFJ6PUYJG3PX5GJISPS2DIRC7JAA, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:38.198902936 (14h57m52.190938359s) [noise=true , address=77.90.31.16:4752 , piece_id=DQ4TSOD7YOHUHENTIXI2Q4J7HHWKG73TQBBK2ABYBUAN2AUJF67A, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:38.337552844 (14h57m52.329588257s) [noise=true , address=77.90.31.21:4896 , piece_id=DJB2ZH4LOCPESSDHZE4BQCL6ZSG26G633JDS3SO2TBVYEKTIASBA, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:38.345985780 (14h57m52.338021203s) [noise=true , address=77.90.31.18:4836 , piece_id=TMBDI4PI7PVBBU72EWXMSDBFEFEPATTIJV2WF33KLUU5FJK2SWUA, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:38.364980165 (14h57m52.357015578s) [noise=true , address=104.36.82.23:4446 , piece_id=C3DMUXDI3TF5MFF5H2WMUHPODRU3AFAXDVOKUK6VQ72JQ5YY2M5Q, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:38.373656647 (14h57m52.36569207s) [noise=true , address=104.36.82.9:4011 , piece_id=UXTDXTQW4VWAWSQUAIV3PVGJV7CMMUVGHRGIZLUWU4EZXWXQE3VQ, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:50:42.535297947 (14h57m56.52733337s) [noise=true , address=77.90.31.10:4521 , piece_id=JR7S7PWZEJS6LU7WNUD5NIFPISZVR6UJNXFCNTOBB4YYSVHIXA6A, seg_pos={0 0}, upload=15457]: Done uploading piece. err: <nil> Aug 29 07:51:34.978186150 (14h58m48.970221583s) [noise=true , address=77.90.31.17:4787 , piece_id=TPANGYHTEUPWOPPU2TNSQRSIF7LXOFZ3ID6UXWK4WTE3OYH7LFCQ, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: expected piece hash; context deadline exceeded; EOF Aug 29 07:51:34.978379540 (14h58m48.970414963s) [noise=true , address=45.91.116.12:4249 , piece_id=3ODASCO6JMQPNURQLDF3XR3U7TNGRJE3WYESCOQRH4WRWC3ZKZVQ, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:12ghkFFJVqKzG9GbJjYVtcadUCr64bCY8dkEjbYGSShMG9e7WvA, address:45.91.116.12:4249): protocol: read tcp 188.166.225.170:55102->45.91.116.12:4249: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:51:34.978516562 (14h58m48.970551995s) [noise=true , address=77.90.31.14:4695 , piece_id=JMABP7F5AO6ZI75C6XLPQ6R4U7EELZJ2RPJQ4NKCPZMQQRUYQ2EA, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 188.166.225.170:50228->77.90.31.14:4695: use of closed network connection; write tcp 188.166.225.170:50228->77.90.31.14:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50228->77.90.31.14:4695: use of closed network connection Aug 29 07:51:34.978581988 (14h58m48.970617411s) [noise=true , address=77.90.31.19:4847 , piece_id=4Q44RIYVLK3XOINZWRTG6HUKW2BNBVZQ67RTDOIANOAB6FRKBGUQ, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv, address:77.90.31.19:4847): protocol: write tcp 188.166.225.170:45504->77.90.31.19:4847: use of closed network connection; write tcp 188.166.225.170:45504->77.90.31.19:4847: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45504->77.90.31.19:4847: use of closed network connection Aug 29 07:51:34.978641401 (14h58m48.970676824s) [noise=true , address=77.90.31.11:4563 , piece_id=VD7Q3X2LIT3DTHNTKLRAQQCDANXLSDXVW523L5WHFWNIJSA33ANQ, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb, address:77.90.31.11:4563): protocol: write tcp 188.166.225.170:45164->77.90.31.11:4563: use of closed network connection; write tcp 188.166.225.170:45164->77.90.31.11:4563: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45164->77.90.31.11:4563: use of closed network connection Aug 29 07:51:34.978649577 (14h58m48.970685s) [noise=true , address=77.90.31.12:4615 , piece_id=SPZA6TIOZ56L4WOKVDRI3N4NRHBCOZFE3DYBJJLPSGWMRNWOQZMQ, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR, address:77.90.31.12:4615): protocol: write tcp 188.166.225.170:33310->77.90.31.12:4615: use of closed network connection; write tcp 188.166.225.170:33310->77.90.31.12:4615: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33310->77.90.31.12:4615: use of closed network connection Aug 29 07:51:34.978730041 (14h58m48.970765464s) [noise=true , address=77.90.31.13:4637 , piece_id=VN6HWNN6XPNGDDPZVEYYR7GT5LUYBXA5XRLGMERKFP4DW4RQ7MIA, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:12Myourwn6UnUxVkxzBdRJApeAGNrZzjrgLgzAfki6x9JZ1Fy17, address:77.90.31.13:4637): protocol: write tcp 188.166.225.170:36420->77.90.31.13:4637: use of closed network connection; write tcp 188.166.225.170:36420->77.90.31.13:4637: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36420->77.90.31.13:4637: use of closed network connection Aug 29 07:51:34.978771470 (14h58m48.970806893s) [noise=true , address=104.36.82.48:4582 , piece_id=R5LMSXAGIMTNKBUI3EQDCODU5VCM5YGDORIKCPBAV6SRB4H75DGA, seg_pos={0 0}, upload=15457]: Done uploading piece. err: ecclient: upload failed (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn, address:104.36.82.48:4582): protocol: write tcp 188.166.225.170:34228->104.36.82.48:4582: use of closed network connection; write tcp 188.166.225.170:34228->104.36.82.48:4582: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34228->104.36.82.48:4582: use of closed network connection Aug 29 07:51:34.978788392 (14h58m48.970823815s) [seg_pos={0 0}, upload=15457]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 07:51:35.241546206 (14h58m49.233581629s) [upload=15457]: Done uploading segments... Aug 29 07:51:35.241573529 (14h58m49.233608952s) [upload=15457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.265317916s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 415.269207ms remote: "tcp:13.203.125.58:443" response headers: Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Cluster-Name=ap-south-1-prod-hosting-red Cf-Ray=976a76cabcf5ff73-BOM Age=218349 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html Surrogate-Control=max-age=2147483647 Date=Fri, 29 Aug 2025 07:51:34 GMT Vary=Accept-Encoding Set-Cookie=_cfuvid=oAYIFVGsapA_pNwIcML_dVNg7tP404meEBSv4Fxefes-1756453894875-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target: https://www.storj.io/ FAIL (2025-08-29 07:51:34 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 415.29183ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [........................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.264516857s FAIL (2025-08-29 07:51:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== 3DCLERCADDTDDEZH2DUK5CBBUGZVXVW2SNUZQYRFRSMFQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.362233567 (14h58m17.35426901s) [noise=true , address=45.91.116.7:4011 , piece_id=OQ63H7JMFV6EPEZCH675KL5DJU225KIKNGBZ3E3DGLH2SSZUXOCA, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.362726771 (14h58m17.354762194s) [noise=true , address=45.91.116.8:4045 , piece_id=GLOYAKLPQFVNGZHH5WBALBA34YQU6MATYKP3U53BMIGDHGQMD2BA, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.363021054 (14h58m17.355056487s) [noise=true , address=104.36.82.5:4839 , piece_id=O5WS3ZWTZVVVQJKVG43RWWEMV6VXH3VLKNBKQUQSXJXX6XAKASQA, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.363352468 (14h58m17.355387901s) [noise=true , address=45.91.116.13:4154 , piece_id=HADQW5EZLQ2BL5GMNPOQYT3K6FLNRINX6ALPI2JA7JDRX6B4GH3A, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.363763014 (14h58m17.355798437s) [noise=true , address=104.36.82.10:4077 , piece_id=UXM4SDZL6NYNXXZOQ7JBG4WEEYFYCL3D4LKMSPYGIQEHUPCECAOQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.364213997 (14h58m17.35624942s) [noise=true , address=77.90.31.14:4663 , piece_id=7KSC5OOHCHEYCQO5METRP4RYZZHQKHAEXMTNZXNYHWNRSW2N5ZMQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.365485650 (14h58m17.357521073s) [noise=true , address=45.91.116.4:4938 , piece_id=J347MMZG4JHBKTXNL34XEL6QJMIOP5CRZI7NR6HPUWEUIPQB7MPQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.365879063 (14h58m17.357914486s) [noise=true , address=45.91.116.14:4191 , piece_id=J55B2MBCMIYNGU5ROED2DVIMRQ6UIZWL32E4MY2NL6MEMSQCDPKA, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.366265793 (14h58m17.358301226s) [noise=true , address=45.91.116.5:4298 , piece_id=NBICPIKG2A7L6OJWJM7W6VMTCXYSTMNFHXF2MBKCGQ4R7YMGJCBA, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.366539737 (14h58m17.35857516s) [noise=true , address=45.91.116.12:4227 , piece_id=EYXHOVUGM7SVEHTFZLUMPTQS5UV6GPLWRKZ3R55OWDA3ZK4GADUA, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.366825704 (14h58m17.358861127s) [noise=true , address=104.36.82.6:4875 , piece_id=4CTNBEDKHUOKYMN2VNFBDT5GCJQPK6EVDBUMUZFSSPUVCTWHTTOQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.367129165 (14h58m17.359164588s) [noise=true , address=104.36.82.15:4257 , piece_id=MRNXY7USJTZFUSOU6EELZ3IXFKPS7QWT5PSZAK4V6ABW6S6UZYVQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.367556222 (14h58m17.359591645s) [noise=true , address=45.91.116.6:4973 , piece_id=6XJB3XQDFZ67CPBWLAPU3UL5IB4QA2JTRIN7CRMGDMGJEHZTYPUQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:03.367830928 (14h58m17.359866351s) [noise=true , address=104.36.82.15:4258 , piece_id=RQRRSMTSIBKF37WOL3URFLWYHIDBN376LXCX4SG4RG5OQ7SARHDQ, seg_pos={0 0}, upload=15464]: Uploading piece... Aug 29 07:51:05.216472819 (14h58m19.208508252s) [upload=15464]: Next returned nil segment Aug 29 07:51:05.216489631 (14h58m19.208525054s) [upload=15464]: Waiting for error group managing segments... Aug 29 07:51:05.507231361 (14h58m19.499266784s) [noise=true , address=45.91.116.5:4298 , piece_id=NBICPIKG2A7L6OJWJM7W6VMTCXYSTMNFHXF2MBKCGQ4R7YMGJCBA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Aug 29 07:51:05.619615562 (14h58m19.611650985s) [noise=true , address=45.91.116.14:4191 , piece_id=J55B2MBCMIYNGU5ROED2DVIMRQ6UIZWL32E4MY2NL6MEMSQCDPKA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Aug 29 07:51:05.662678251 (14h58m19.654713674s) [noise=true , address=104.36.82.15:4258 , piece_id=RQRRSMTSIBKF37WOL3URFLWYHIDBN376LXCX4SG4RG5OQ7SARHDQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Aug 29 07:51:08.346234790 (14h58m22.338270243s) [noise=true , address=45.91.116.8:4045 , piece_id=GLOYAKLPQFVNGZHH5WBALBA34YQU6MATYKP3U53BMIGDHGQMD2BA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Aug 29 07:51:08.528119136 (14h58m22.520154559s) [noise=true , address=45.91.116.7:4011 , piece_id=OQ63H7JMFV6EPEZCH675KL5DJU225KIKNGBZ3E3DGLH2SSZUXOCA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Aug 29 07:51:11.502210398 (14h58m25.494245821s) [noise=true , address=45.91.116.5:4299 , piece_id=A6XMU4P5GKMSNWBO4QWPWFH3WVN5KBUB474F5OEY5HMVYBU5GXBA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Aug 29 07:51:17.010941829 (14h58m31.002977252s) [noise=true , address=104.36.82.15:4257 , piece_id=MRNXY7USJTZFUSOU6EELZ3IXFKPS7QWT5PSZAK4V6ABW6S6UZYVQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Aug 29 07:51:32.322918731 (14h58m46.314954154s) [noise=true , address=104.36.82.5:4839 , piece_id=O5WS3ZWTZVVVQJKVG43RWWEMV6VXH3VLKNBKQUQSXJXX6XAKASQA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:104.36.82.5:4839): protocol: write tcp 188.166.225.170:56660->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:56660->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56660->104.36.82.5:4839: use of closed network connection Aug 29 07:51:32.322971611 (14h58m46.315007024s) [noise=true , address=104.36.82.6:4875 , piece_id=4CTNBEDKHUOKYMN2VNFBDT5GCJQPK6EVDBUMUZFSSPUVCTWHTTOQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:104.36.82.6:4875): protocol: write tcp 188.166.225.170:46974->104.36.82.6:4875: use of closed network connection; write tcp 188.166.225.170:46974->104.36.82.6:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46974->104.36.82.6:4875: use of closed network connection Aug 29 07:51:32.323128361 (14h58m46.315163784s) [noise=true , address=45.91.116.6:4973 , piece_id=6XJB3XQDFZ67CPBWLAPU3UL5IB4QA2JTRIN7CRMGDMGJEHZTYPUQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 188.166.225.170:47856->45.91.116.6:4973: use of closed network connection; write tcp 188.166.225.170:47856->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47856->45.91.116.6:4973: use of closed network connection Aug 29 07:51:32.323180662 (14h58m46.315216075s) [noise=true , address=45.91.116.13:4154 , piece_id=HADQW5EZLQ2BL5GMNPOQYT3K6FLNRINX6ALPI2JA7JDRX6B4GH3A, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:51:32.323216961 (14h58m46.315252384s) [noise=true , address=77.90.31.14:4663 , piece_id=7KSC5OOHCHEYCQO5METRP4RYZZHQKHAEXMTNZXNYHWNRSW2N5ZMQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:50666->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:50666->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50666->77.90.31.14:4663: use of closed network connection Aug 29 07:51:32.323241878 (14h58m46.315277301s) [noise=true , address=45.91.116.8:4047 , piece_id=QCT22RG3DCLERCADDTDDEZH2DUK5CBBUGZVXVW2SNUZQYRFRSMFQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 188.166.225.170:36168->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:51:32.323279671 (14h58m46.315315094s) [noise=true , address=45.91.116.12:4227 , piece_id=EYXHOVUGM7SVEHTFZLUMPTQS5UV6GPLWRKZ3R55OWDA3ZK4GADUA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 188.166.225.170:37924->45.91.116.12:4227: use of closed network connection; write tcp 188.166.225.170:37924->45.91.116.12:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37924->45.91.116.12:4227: use of closed network connection Aug 29 07:51:32.323314388 (14h58m46.315349811s) [noise=true , address=45.91.116.4:4938 , piece_id=J347MMZG4JHBKTXNL34XEL6QJMIOP5CRZI7NR6HPUWEUIPQB7MPQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:34798->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:51:32.323401274 (14h58m46.315436737s) [noise=true , address=104.36.82.10:4077 , piece_id=UXM4SDZL6NYNXXZOQ7JBG4WEEYFYCL3D4LKMSPYGIQEHUPCECAOQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:104.36.82.10:4077): protocol: read tcp 188.166.225.170:45376->104.36.82.10:4077: use of closed network connection; conn closed: op Aug 29 07:51:32.323432784 (14h58m46.315468247s) [seg_pos={0 0}, upload=15464]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Aug 29 07:51:32.586522933 (14h58m46.578558356s) [upload=15464]: Done uploading segments... Aug 29 07:51:32.586548903 (14h58m46.578584326s) [upload=15464]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 30.264543178s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 365.392179ms remote: "tcp:13.233.175.166:443" response headers: Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:51:14 GMT Content-Type=text/html Vary=Accept-Encoding Cf-Ray=976a764c5ef52772-BOM Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Set-Cookie=_cfuvid=8ECfmOevRZUQCMXwviFMVlUKxb8urryNvUVi2qEZA_Y-1756453874652-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Cache-Status=HIT Age=218099 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e target: https://www.storj.io/ FAIL (2025-08-29 07:51:14 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 365.427878ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 21 out of 60 is failed (threshold=3) [................................XX.......XXXXXXXXXXXXXXXXXXX] duration: 1m0.251720634s FAIL (2025-08-29 07:51:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== , piece_id=K7R7M3SK7CMUNHIVXGQYKIBQRRTB4BTX2ZEYPFEXBA373HJGL3DA, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.320516954 (14h57m17.312552377s) [noise=true , address=79.127.219.51:4186 , piece_id=JCZKP255CKFGW4K455QYD4RE33RFML7FZQL5FMOY5BN5EWYLQNIA, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.320753678 (14h57m17.312789111s) [noise=true , address=45.91.116.12:4234 , piece_id=LC3RXSAOTRAGP4T4DUPSAUSMDNRQ5SD2XTNYFEZ2YCWZ7JKU72XA, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.321012793 (14h57m17.313048226s) [noise=true , address=77.90.31.10:4531 , piece_id=OBLYSQ7NYWTBMMDGQXPC6TAQ73ZMWAQIVDADTEPAJEEXGM5NXXWA, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.321313038 (14h57m17.313348491s) [noise=true , address=104.36.82.48:4566 , piece_id=5CUWU3VHXV6GY7UI2POBBASGI6PMT7CSBFJWQXV2URO3T4TQHFBQ, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.321551154 (14h57m17.313586577s) [noise=true , address=104.36.82.48:4586 , piece_id=4A7A3AYMJMML636FBR3F3ERB3H7HU6VEWHIVT6633H47XAPBLXWQ, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.321791253 (14h57m17.313826676s) [noise=true , address=77.90.31.16:4748 , piece_id=EE5AQLHTRDRYAAO6AAFRN7R5D5HKTZCPR6SG52DVZQLNAEVZ25EQ, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.322171591 (14h57m17.314207014s) [noise=true , address=77.90.31.13:4641 , piece_id=BHE4T7YLCVYEWN4BQS5XFSEO7DEZR3QD3CVWRDX43JLHG7ZOCKGQ, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.322668622 (14h57m17.314704045s) [noise=true , address=104.36.82.23:4454 , piece_id=NG3NGQCFV7TH2Z2BDIG7NUF4PPWKE6KSXBXNAWZKD5R47CYKM2TA, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.323026336 (14h57m17.315061759s) [noise=true , address=45.91.116.4:4969 , piece_id=MRF5NX6NGNMAHD4IRH6BOSEHGUIYISXVPATJHXQHVA2R6XCDXPMA, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.323351158 (14h57m17.315386581s) [noise=true , address=45.91.116.8:4060 , piece_id=Z2KO7VQSOWXPYKOZQQBUHK35YNWWUIRXZUUKMS2RHWPGUGXTI2WQ, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:03.323895981 (14h57m17.315931404s) [noise=true , address=104.36.82.5:4846 , piece_id=Y5EOSWHAV4KDM35C6CPDJGG6T2QNFRWFOZNYVRWPPAZMP4HRUDZQ, seg_pos={0 0}, upload=15449]: Uploading piece... Aug 29 07:50:04.516202677 (14h57m18.50823811s) [upload=15449]: Next returned nil segment Aug 29 07:50:04.516225651 (14h57m18.508261074s) [upload=15449]: Waiting for error group managing segments... Aug 29 07:50:04.843437494 (14h57m18.835472927s) [noise=true , address=64.49.13.138:4482 , piece_id=TIB6ZLIBL4WPZXERXBEOH2M5U6T3OI5QWDDE5YGUU6IPD2BGF5JA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:04.857389040 (14h57m18.849424483s) [noise=true , address=79.127.205.245:4245 , piece_id=XMAA32TDFD2IH3LJNZ4AHUTOYMT5AAGPV4RFT6S6ZLP34BGCHHEQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:05.306447360 (14h57m19.298482793s) [noise=true , address=156.146.43.225:4445 , piece_id=VF2XO4WJXKXUM5B5E2JIWS2O4PEJSFYMWDXN4ZO2HNRHXQI6I7BQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:05.316412107 (14h57m19.30844754s) [noise=true , address=79.127.219.51:4186 , piece_id=JCZKP255CKFGW4K455QYD4RE33RFML7FZQL5FMOY5BN5EWYLQNIA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:05.371799027 (14h57m19.36383445s) [noise=true , address=45.91.116.8:4060 , piece_id=Z2KO7VQSOWXPYKOZQQBUHK35YNWWUIRXZUUKMS2RHWPGUGXTI2WQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:05.388503691 (14h57m19.380539114s) [noise=true , address=77.90.31.17:4802 , piece_id=HJXJVQWE4YNJYRFMUAEGSWFT2AOT3TLO4DKVSDEVKLJ3LJS4VB4A, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:05.393431078 (14h57m19.385466501s) [noise=true , address=77.90.31.11:4566 , piece_id=NLT6I52YALHSDVPYFQNKKR4AEGGZYPL2YOBPTORANT23Q4VXYUAA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:05.449276927 (14h57m19.44131235s) [noise=true , address=104.36.82.48:4566 , piece_id=5CUWU3VHXV6GY7UI2POBBASGI6PMT7CSBFJWQXV2URO3T4TQHFBQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:05.513848281 (14h57m19.505883724s) [noise=true , address=77.90.31.13:4641 , piece_id=BHE4T7YLCVYEWN4BQS5XFSEO7DEZR3QD3CVWRDX43JLHG7ZOCKGQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:50:07.839530886 (14h57m21.831566309s) [noise=true , address=77.90.31.10:4531 , piece_id=OBLYSQ7NYWTBMMDGQXPC6TAQ73ZMWAQIVDADTEPAJEEXGM5NXXWA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: <nil> Aug 29 07:51:02.088040084 (14h58m16.080075517s) [noise=true , address=45.91.116.4:4969 , piece_id=MRF5NX6NGNMAHD4IRH6BOSEHGUIYISXVPATJHXQHVA2R6XCDXPMA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:12h5esfg6mw2c8y3AVpeFBkL5FfLAwYdjhcnQ9CJ8fjh61WLYjx, address:45.91.116.4:4969): protocol: expected piece hash; write tcp 188.166.225.170:49056->45.91.116.4:4969: use of closed network connection; write tcp 188.166.225.170:49056->45.91.116.4:4969: use of closed network connection; EOF Aug 29 07:51:02.088266366 (14h58m16.080301799s) [noise=true , address=104.36.82.23:4454 , piece_id=NG3NGQCFV7TH2Z2BDIG7NUF4PPWKE6KSXBXNAWZKD5R47CYKM2TA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2, address:104.36.82.23:4454): protocol: write tcp 188.166.225.170:41724->104.36.82.23:4454: use of closed network connection; write tcp 188.166.225.170:41724->104.36.82.23:4454: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41724->104.36.82.23:4454: use of closed network connection Aug 29 07:51:02.088348704 (14h58m16.080384137s) [noise=true , address=104.36.82.5:4846 , piece_id=Y5EOSWHAV4KDM35C6CPDJGG6T2QNFRWFOZNYVRWPPAZMP4HRUDZQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR, address:104.36.82.5:4846): protocol: write tcp 188.166.225.170:60216->104.36.82.5:4846: use of closed network connection; write tcp 188.166.225.170:60216->104.36.82.5:4846: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60216->104.36.82.5:4846: use of closed network connection Aug 29 07:51:02.088392828 (14h58m16.080428251s) [noise=true , address=77.90.31.21:4886 , piece_id=K7R7M3SK7CMUNHIVXGQYKIBQRRTB4BTX2ZEYPFEXBA373HJGL3DA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:12VMSq3AX3PYjchs8n7yDWVWdKVRUVoe3PiyDitkX1EwSUwsTeM, address:77.90.31.21:4886): protocol: write tcp 188.166.225.170:40524->77.90.31.21:4886: use of closed network connection; write tcp 188.166.225.170:40524->77.90.31.21:4886: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40524->77.90.31.21:4886: use of closed network connection Aug 29 07:51:02.088430320 (14h58m16.080465753s) [noise=true , address=45.91.116.12:4234 , piece_id=LC3RXSAOTRAGP4T4DUPSAUSMDNRQ5SD2XTNYFEZ2YCWZ7JKU72XA, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:1mmKSzdU8tViT7WLrppbMMsbAzB2MetMSoLj6ToyLHyQ5RaNjA, address:45.91.116.12:4234): protocol: write tcp 188.166.225.170:48516->45.91.116.12:4234: use of closed network connection; write tcp 188.166.225.170:48516->45.91.116.12:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48516->45.91.116.12:4234: use of closed network connection Aug 29 07:51:02.088481799 (14h58m16.080517232s) [noise=true , address=104.36.82.48:4586 , piece_id=4A7A3AYMJMML636FBR3F3ERB3H7HU6VEWHIVT6633H47XAPBLXWQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:12YdSTc2X61baRotZGev4q25BFkEspbienJtMcpbQvGgbyCRYfx, address:104.36.82.48:4586): protocol: write tcp 188.166.225.170:56176->104.36.82.48:4586: use of closed network connection; write tcp 188.166.225.170:56176->104.36.82.48:4586: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->104.36.82.48:4586: use of closed network connection Aug 29 07:51:02.088570608 (14h58m16.080606042s) [noise=true , address=77.90.31.16:4748 , piece_id=EE5AQLHTRDRYAAO6AAFRN7R5D5HKTZCPR6SG52DVZQLNAEVZ25EQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:12k122BWfbKgBxSs8MCfNFkZYh2WfZDDHLktLQRiifkPr95G7SY, address:77.90.31.16:4748): protocol: write tcp 188.166.225.170:40792->77.90.31.16:4748: use of closed network connection; write tcp 188.166.225.170:40792->77.90.31.16:4748: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40792->77.90.31.16:4748: use of closed network connection Aug 29 07:51:02.088583222 (14h58m16.080618645s) [noise=true , address=104.36.82.23:4473 , piece_id=PML4MPENZZNR22VMI6GVVXC3SZXF7HSYEWR6VGYHW6U2J4VKJZFQ, seg_pos={0 0}, upload=15449]: Done uploading piece. err: ecclient: upload failed (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC, address:104.36.82.23:4473): protocol: write tcp 188.166.225.170:51090->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:51090->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51090->104.36.82.23:4473: use of closed network connection Aug 29 07:51:02.088616937 (14h58m16.08065237s) [seg_pos={0 0}, upload=15449]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 29 07:51:02.338068199 (14h58m16.330103622s) [upload=15449]: Done uploading segments... Aug 29 07:51:02.338097645 (14h58m16.330133079s) [upload=15449]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.251741194s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 21 out of 60 is failed (threshold=3) [...............................XX........XXXXXXXXXXXXXXXXXXX] duration: 1m0.258268524s FAIL (2025-08-29 07:50:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 6) ======LOGS====== Aug 29 07:49:35.179319776 (14h56m49.171355199s) [upload=15442]: Starting upload Aug 29 07:49:35.179403256 (14h56m49.171438679s) [upload=15442]: Done starting upload Aug 29 07:49:35.179524778 (14h56m49.171560201s) [upload=15442]: Uploading segments... Aug 29 07:49:35.179737745 (14h56m49.171773168s) [upload=15442]: Got next segment. Inline: false Aug 29 07:49:35.179822297 (14h56m49.17185772s) [upload=15442]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:49:35.179828659 (14h56m49.171864082s) [upload=15442]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:49:35.686435206 (14h56m49.678470629s) [seg_pos={0 0}, upload=15442]: Begin upload segment... Aug 29 07:49:35.686480361 (14h56m49.678515784s) [seg_pos={0 0}, upload=15442]: Done begin upload segment. Aug 29 07:49:35.686504207 (14h56m49.67853963s) [noise=true , address=79.127.219.48:4101 , piece_id=3TIMO2BBNJ3L44ZAE4ONWKTNZPLN4ECAS5OC5UDDS7QYI2WGZX4A, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.686528774 (14h56m49.678564197s) [noise=true , address=45.91.116.9:4279 , piece_id=27LGEUWJ56JIOWGBTE2F46DYNBDZ7MD3ZVAXJVSK2LW3HGVBQNYA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.686964919 (14h56m49.679000342s) [noise=true , address=104.36.82.6:4904 , piece_id=64XV6T5ZXKG7RCQBHYZNFS2YCUGAXTDJV6FZ6LNRKXW4V6MV6QCA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.687137499 (14h56m49.679172912s) [noise=true , address=104.36.82.2:4758 , piece_id=25HXOVKNCERS3WR5QTVRD34YCI44GPIPY4IOJ4NSWVHVB2C3XAXA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.687342632 (14h56m49.679378055s) [noise=true , address=104.36.82.48:4588 , piece_id=SG2HGCNY6FEMGUGVEJHGT7KXDRGNXLNTYJKRQHCZAYVIBW7K3CFQ, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.687484343 (14h56m49.679519766s) [noise=true , address=77.90.31.10:4550 , piece_id=6GVEQWGGMN34GHTOLXIZPBVNAUKY3MA7OPMFUNN5WOFNCXM4YF2A, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.687660479 (14h56m49.679695902s) [noise=true , address=104.36.82.44:4882 , piece_id=7VSLUXF6YRCMDWDGARU6L626QPKRPVPSWEUA3PPGBUGB3QBZG3NQ, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.688612501 (14h56m49.680647924s) [noise=true , address=77.90.31.13:4636 , piece_id=QBIFVQGWQ7B37AFJK4EOLA6TDVFGEN2VRPEXYNI6TAJS53IN5O2A, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.688940729 (14h56m49.680976152s) [noise=true , address=45.91.116.4:4946 , piece_id=2M4DIPNVTJWLOZYYVRSLAMBX37WO4QCMBY34724MBERPGI7HYPMA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.689780887 (14h56m49.68181631s) [noise=true , address=104.36.82.23:4454 , piece_id=UFKTAR2MCBTTME2QLVLGQQODC7G7ZWD7ARINT73QCB6VHVAJCAZQ, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.690623931 (14h56m49.682659354s) [noise=true , address=77.90.31.12:4607 , piece_id=6U4RYWWZ4Q6RYYXR63OXKPVYSRJ54TB4NWINBIPWIGFZW62HXNAQ, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.690941427 (14h56m49.682976851s) [noise=true , address=79.127.205.245:4251 , piece_id=PWSNK4F3A6GSC2KWZVXSZ7CFXVVAWSKSEEWGPAXOD3QZ3LNL4X4A, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.691179734 (14h56m49.683215157s) [noise=true , address=77.90.31.21:4893 , piece_id=4H74HLKPCOH7ECJFORMGIAYCV6OEOA3USHMPB2GFSOBRTTQ6HH2A, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.691498935 (14h56m49.683534358s) [noise=true , address=77.90.31.11:4562 , piece_id=HPD7ENK236MVDKRYKUQEHKT2OJM5ARZOYL3UFMUGVLR6DMTQMXJA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.691721420 (14h56m49.683756844s) [noise=true , address=77.90.31.16:4759 , piece_id=JGVKPRULFNKVOB7TOH4EF6YH5AROIEIFVRKHJPP2IKTKQ5R2BHHA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.692011375 (14h56m49.684046798s) [noise=true , address=77.90.31.17:4787 , piece_id=STPOONT7ZWHHY6GAO2XE7EU24JFKB3ZFHG6JLFPWDZRJ5OZYWKGA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.692336998 (14h56m49.684372421s) [noise=true , address=45.91.116.8:4057 , piece_id=KXNZ4PCHTU5YGMWCWL7NO6JX44ZXCKTLWATQ6VO5XBPQDLPWNSOA, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:35.692583710 (14h56m49.684619133s) [noise=true , address=104.36.82.5:4862 , piece_id=UTW4AKSFBTKEESD44ZCYVKD3YUY7NL35AVVHRH7U5I7GKJJ242YQ, seg_pos={0 0}, upload=15442]: Uploading piece... Aug 29 07:49:36.829787402 (14h56m50.821822825s) [upload=15442]: Next returned nil segment Aug 29 07:49:36.829815305 (14h56m50.821850728s) [upload=15442]: Waiting for error group managing segments... Aug 29 07:49:37.146513691 (14h56m51.138549114s) [noise=true , address=79.127.205.245:4251 , piece_id=PWSNK4F3A6GSC2KWZVXSZ7CFXVVAWSKSEEWGPAXOD3QZ3LNL4X4A, seg_pos={0 0}, upload=15442]: Done uploading piece. err: <nil> Aug 29 07:49:37.673953811 (14h56m51.665989234s) [noise=true , address=79.127.219.48:4101 , piece_id=3TIMO2BBNJ3L44ZAE4ONWKTNZPLN4ECAS5OC5UDDS7QYI2WGZX4A, seg_pos={0 0}, upload=15442]: Done uploading piece. err: <nil> Aug 29 07:49:37.688562303 (14h56m51.680597726s) [noise=true , address=104.36.82.48:4588 , piece_id=SG2HGCNY6FEMGUGVEJHGT7KXDRGNXLNTYJKRQHCZAYVIBW7K3CFQ, seg_pos={0 0}, upload=15442]: Done uploading piece. err: <nil> Aug 29 07:49:37.800714551 (14h56m51.792749974s) [noise=true , address=77.90.31.16:4759 , piece_id=JGVKPRULFNKVOB7TOH4EF6YH5AROIEIFVRKHJPP2IKTKQ5R2BHHA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: <nil> Aug 29 07:49:37.806589712 (14h56m51.798625145s) [noise=true , address=45.91.116.8:4057 , piece_id=KXNZ4PCHTU5YGMWCWL7NO6JX44ZXCKTLWATQ6VO5XBPQDLPWNSOA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: <nil> Aug 29 07:49:37.889630337 (14h56m51.88166579s) [noise=true , address=104.36.82.5:4862 , piece_id=UTW4AKSFBTKEESD44ZCYVKD3YUY7NL35AVVHRH7U5I7GKJJ242YQ, seg_pos={0 0}, upload=15442]: Done uploading piece. err: <nil> Aug 29 07:50:34.452116831 (14h57m48.444152254s) [noise=true , address=77.90.31.21:4893 , piece_id=4H74HLKPCOH7ECJFORMGIAYCV6OEOA3USHMPB2GFSOBRTTQ6HH2A, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:1NgPjVCyZZAfxVr3WvKrGRjnkpPtUvmQcCMiYntxNKVSWqXcHC, address:77.90.31.21:4893): protocol: write tcp 188.166.225.170:54226->77.90.31.21:4893: use of closed network connection; write tcp 188.166.225.170:54226->77.90.31.21:4893: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54226->77.90.31.21:4893: use of closed network connection Aug 29 07:50:34.452219857 (14h57m48.44425528s) [noise=true , address=77.90.31.17:4787 , piece_id=STPOONT7ZWHHY6GAO2XE7EU24JFKB3ZFHG6JLFPWDZRJ5OZYWKGA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 188.166.225.170:50910->77.90.31.17:4787: use of closed network connection; write tcp 188.166.225.170:50910->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50910->77.90.31.17:4787: use of closed network connection Aug 29 07:50:34.452231430 (14h57m48.444266853s) [noise=true , address=45.91.116.9:4279 , piece_id=27LGEUWJ56JIOWGBTE2F46DYNBDZ7MD3ZVAXJVSK2LW3HGVBQNYA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:124aq2BHBfu1qSRXCx5XVZJU5U7gzadYHSRLYT8fcwcrtu9z5jG, address:45.91.116.9:4279): protocol: write tcp 188.166.225.170:43940->45.91.116.9:4279: use of closed network connection; write tcp 188.166.225.170:43940->45.91.116.9:4279: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43940->45.91.116.9:4279: use of closed network connection Aug 29 07:50:34.452283249 (14h57m48.444318672s) [noise=true , address=77.90.31.11:4562 , piece_id=HPD7ENK236MVDKRYKUQEHKT2OJM5ARZOYL3UFMUGVLR6DMTQMXJA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:1SXQ4wGnLgKifp7pWWtKGtCom5K7fGceJHy2SyLGvUemZx4H4r, address:77.90.31.11:4562): protocol: write tcp 188.166.225.170:47382->77.90.31.11:4562: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.11:4562: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.11:4562: use of closed network connection Aug 29 07:50:34.452337723 (14h57m48.444373146s) [noise=true , address=104.36.82.2:4758 , piece_id=25HXOVKNCERS3WR5QTVRD34YCI44GPIPY4IOJ4NSWVHVB2C3XAXA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:1joBbXdmusUXDfe1ofLp5oXy1nVkkRAng8QGL2hAtKjDz71u5g, address:104.36.82.2:4758): protocol: write tcp 188.166.225.170:34592->104.36.82.2:4758: use of closed network connection; write tcp 188.166.225.170:34592->104.36.82.2:4758: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34592->104.36.82.2:4758: use of closed network connection Aug 29 07:50:34.452382238 (14h57m48.444417661s) [noise=true , address=104.36.82.44:4882 , piece_id=7VSLUXF6YRCMDWDGARU6L626QPKRPVPSWEUA3PPGBUGB3QBZG3NQ, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:104.36.82.44:4882): protocol: write tcp 188.166.225.170:51764->104.36.82.44:4882: use of closed network connection; write tcp 188.166.225.170:51764->104.36.82.44:4882: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51764->104.36.82.44:4882: use of closed network connection Aug 29 07:50:34.452448154 (14h57m48.444483577s) [noise=true , address=45.91.116.4:4946 , piece_id=2M4DIPNVTJWLOZYYVRSLAMBX37WO4QCMBY34724MBERPGI7HYPMA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:18tmori7tiA7FvTDd5MXLX7F2DoAxg3QFNtZHwCMnVtgwP7uve, address:45.91.116.4:4946): protocol: write tcp 188.166.225.170:59796->45.91.116.4:4946: use of closed network connection; write tcp 188.166.225.170:59796->45.91.116.4:4946: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59796->45.91.116.4:4946: use of closed network connection Aug 29 07:50:34.452477601 (14h57m48.444513024s) [noise=true , address=77.90.31.12:4607 , piece_id=6U4RYWWZ4Q6RYYXR63OXKPVYSRJ54TB4NWINBIPWIGFZW62HXNAQ, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm, address:77.90.31.12:4607): protocol: write tcp 188.166.225.170:44736->77.90.31.12:4607: use of closed network connection; write tcp 188.166.225.170:44736->77.90.31.12:4607: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44736->77.90.31.12:4607: use of closed network connection Aug 29 07:50:34.452494372 (14h57m48.444529795s) [noise=true , address=104.36.82.23:4454 , piece_id=UFKTAR2MCBTTME2QLVLGQQODC7G7ZWD7ARINT73QCB6VHVAJCAZQ, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2, address:104.36.82.23:4454): protocol: write tcp 188.166.225.170:58574->104.36.82.23:4454: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:50:34.452502999 (14h57m48.444538422s) [noise=true , address=77.90.31.10:4550 , piece_id=6GVEQWGGMN34GHTOLXIZPBVNAUKY3MA7OPMFUNN5WOFNCXM4YF2A, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: write tcp 188.166.225.170:54294->77.90.31.10:4550: use of closed network connection; write tcp 188.166.225.170:54294->77.90.31.10:4550: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54294->77.90.31.10:4550: use of closed network connection Aug 29 07:50:34.452518619 (14h57m48.444554042s) [noise=true , address=104.36.82.6:4904 , piece_id=64XV6T5ZXKG7RCQBHYZNFS2YCUGAXTDJV6FZ6LNRKXW4V6MV6QCA, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:1y8S5sEV2o6s823Jb5f11EmDHGbQaFkWZ18k9TCii3TR5vRt9y, address:104.36.82.6:4904): protocol: write tcp 188.166.225.170:32908->104.36.82.6:4904: use of closed network connection; write tcp 188.166.225.170:32908->104.36.82.6:4904: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32908->104.36.82.6:4904: use of closed network connection Aug 29 07:50:34.452553877 (14h57m48.4445893s) [noise=true , address=77.90.31.13:4636 , piece_id=QBIFVQGWQ7B37AFJK4EOLA6TDVFGEN2VRPEXYNI6TAJS53IN5O2A, seg_pos={0 0}, upload=15442]: Done uploading piece. err: ecclient: upload failed (node:123r9xrR18b29rsRY6APtib52WagU7ttLA7MHY4EQ7inh6BjdCB, address:77.90.31.13:4636): protocol: read tcp 188.166.225.170:37176->77.90.31.13:4636: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:50:34.452574005 (14h57m48.444609428s) [seg_pos={0 0}, upload=15442]: Done waiting for segment. successful: 6 optimal: 14 errs: <nil> Aug 29 07:50:34.708140889 (14h57m48.700176312s) [upload=15442]: Done uploading segments... Aug 29 07:50:34.708163102 (14h57m48.700198525s) [upload=15442]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 6) Duration: 1m0.258283252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [.........................XXXX.......XXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.263816775s FAIL (2025-08-29 07:50:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== ploading piece... Aug 29 07:50:03.290416198 (14h57m17.282451621s) [noise=true , address=45.91.116.9:4263 , piece_id=FWQMN5BZTQNI4NHZ3L7O6OHNYQKTAFCSKOHK52HH2BPDHICAD43A, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:03.290619627 (14h57m17.28265506s) [noise=true , address=45.91.116.7:4010 , piece_id=KQE73MDAWVGHO3MP55N4VZT2IIZTSQOYKWTYFRRH4W3LGHBXG3PA, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:03.290705783 (14h57m17.282741206s) [noise=true , address=45.91.116.12:4225 , piece_id=JXBB7ESNR2A3SJD5UPPW73HJ5TY3BSJR4JFTGMMYXEY7WIAFL4VQ, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:03.291049841 (14h57m17.283085274s) [noise=true , address=77.90.31.14:4662 , piece_id=V6VDP24MROASAYGMWQHRWQ2EPT36PMSGZBKGIFMNKEITIORN7NBA, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:03.292078309 (14h57m17.284113752s) [noise=true , address=45.91.116.8:4045 , piece_id=BCDZEEKQ2I5RJRSYYPNR34U5EAOU6WU4SOGS6OMHOIRTYJ2LXM3Q, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:03.292482072 (14h57m17.284517495s) [noise=true , address=104.36.82.7:4911 , piece_id=ZBH5GLRGHR72A7PITEHX46GVHDZBZEZVMYM2RB4UXSLSC3BUTR6A, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:03.292842051 (14h57m17.284877494s) [noise=true , address=77.90.31.13:4626 , piece_id=FNMTTJU6YHTCYPVOX37DQBRBIX2ISY6GHKKDNW44C5MDS3CPS35Q, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:03.293174386 (14h57m17.285209819s) [noise=true , address=45.91.116.6:4975 , piece_id=YZDQTLBFSKLEQ2L3F7T3JA7YINTTBDZLPUOMNO5JPWF5TOZSMFHA, seg_pos={0 0}, upload=15450]: Uploading piece... Aug 29 07:50:05.138766061 (14h57m19.130801484s) [upload=15450]: Next returned nil segment Aug 29 07:50:05.138791279 (14h57m19.130826702s) [upload=15450]: Waiting for error group managing segments... Aug 29 07:50:05.429630494 (14h57m19.421665917s) [noise=true , address=45.91.116.7:4010 , piece_id=KQE73MDAWVGHO3MP55N4VZT2IIZTSQOYKWTYFRRH4W3LGHBXG3PA, seg_pos={0 0}, upload=15450]: Done uploading piece. err: <nil> Aug 29 07:50:05.510207695 (14h57m19.502243118s) [noise=true , address=77.90.31.21:4878 , piece_id=33TFDUR5X2BA32H2PZ3WB77DCX2H4EGAZDCHKOAW52KHSTNC44IQ, seg_pos={0 0}, upload=15450]: Done uploading piece. err: <nil> Aug 29 07:50:05.567123281 (14h57m19.559158704s) [noise=true , address=77.90.31.19:4841 , piece_id=R6D54ULGQDJGLPT2KZXWIK6352EWQ7N6VOYLYHFIPUET3YORYHIA, seg_pos={0 0}, upload=15450]: Done uploading piece. err: <nil> Aug 29 07:50:05.640660871 (14h57m19.632696294s) [noise=true , address=77.90.31.14:4662 , piece_id=V6VDP24MROASAYGMWQHRWQ2EPT36PMSGZBKGIFMNKEITIORN7NBA, seg_pos={0 0}, upload=15450]: Done uploading piece. err: <nil> Aug 29 07:50:27.288242433 (14h57m41.280277856s) [noise=true , address=45.91.116.8:4045 , piece_id=BCDZEEKQ2I5RJRSYYPNR34U5EAOU6WU4SOGS6OMHOIRTYJ2LXM3Q, seg_pos={0 0}, upload=15450]: Done uploading piece. err: <nil> Aug 29 07:50:32.260557341 (14h57m46.252592764s) [noise=true , address=45.91.116.12:4225 , piece_id=JXBB7ESNR2A3SJD5UPPW73HJ5TY3BSJR4JFTGMMYXEY7WIAFL4VQ, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 188.166.225.170:60560->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:60560->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60560->45.91.116.12:4225: use of closed network connection Aug 29 07:50:32.260609240 (14h57m46.252644663s) [noise=true , address=45.91.116.5:4297 , piece_id=FO4KXFSVFDDND6IJFQVNZKXQPHMSJR3NGROZGVVQXCF3FXI5RBAA, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:55936->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:55936->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55936->45.91.116.5:4297: use of closed network connection Aug 29 07:50:32.260650149 (14h57m46.252685572s) [noise=true , address=104.36.82.7:4911 , piece_id=ZBH5GLRGHR72A7PITEHX46GVHDZBZEZVMYM2RB4UXSLSC3BUTR6A, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:104.36.82.7:4911): protocol: write tcp 188.166.225.170:43604->104.36.82.7:4911: use of closed network connection; write tcp 188.166.225.170:43604->104.36.82.7:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43604->104.36.82.7:4911: use of closed network connection Aug 29 07:50:32.260688842 (14h57m46.252724265s) [noise=true , address=77.90.31.13:4626 , piece_id=FNMTTJU6YHTCYPVOX37DQBRBIX2ISY6GHKKDNW44C5MDS3CPS35Q, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34164->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34164->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34164->77.90.31.13:4626: use of closed network connection Aug 29 07:50:32.260707839 (14h57m46.252743262s) [noise=true , address=45.91.116.8:4048 , piece_id=GKAUM5XDQNKZ6DRWPDATSBRQ2BTQWWFK4PITGIR3DFQE5DDWGPOQ, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 188.166.225.170:59934->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:59934->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59934->45.91.116.8:4048: use of closed network connection Aug 29 07:50:32.260727838 (14h57m46.252763261s) [noise=true , address=45.91.116.6:4975 , piece_id=YZDQTLBFSKLEQ2L3F7T3JA7YINTTBDZLPUOMNO5JPWF5TOZSMFHA, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: write tcp 188.166.225.170:59586->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:59586->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59586->45.91.116.6:4975: use of closed network connection Aug 29 07:50:32.260761902 (14h57m46.252797326s) [noise=true , address=104.36.82.14:4221 , piece_id=ZH4XO7MTVK5A3Q5LBJS4BSWV6XOPH4BXJGZWIR7BFTRLVONGWRCQ, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: write tcp 188.166.225.170:59470->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:59470->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59470->104.36.82.14:4221: use of closed network connection Aug 29 07:50:32.260793032 (14h57m46.252828465s) [noise=true , address=45.91.116.13:4153 , piece_id=VK2RTEQTNL6FZTFY467KRDGNWLY43GJY4JSDXYJVKKNH7NH5AP3Q, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:33720->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:33720->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33720->45.91.116.13:4153: use of closed network connection Aug 29 07:50:32.260825784 (14h57m46.252861217s) [noise=true , address=45.91.116.9:4263 , piece_id=FWQMN5BZTQNI4NHZ3L7O6OHNYQKTAFCSKOHK52HH2BPDHICAD43A, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:50232->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:50232->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50232->45.91.116.9:4263: use of closed network connection Aug 29 07:50:32.260842988 (14h57m46.252878421s) [noise=true , address=45.91.116.4:4938 , piece_id=XOTTOJSR5BUBNNMKKHCCXTHADWZL4HMR6MBOLM2AHM5RY4GRAGAA, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:46652->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:46652->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46652->45.91.116.4:4938: use of closed network connection Aug 29 07:50:32.260967806 (14h57m46.253003229s) [noise=true , address=77.90.31.11:4555 , piece_id=CFG7QMLAONLXXBVH6H7EQOJWGJ2FOOPTCGCBXCT7YJJYTCBL7FHQ, seg_pos={0 0}, upload=15450]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 188.166.225.170:49084->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Aug 29 07:50:32.261028363 (14h57m46.253063786s) [seg_pos={0 0}, upload=15450]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Aug 29 07:50:32.523028507 (14h57m46.51506393s) [upload=15450]: Done uploading segments... Aug 29 07:50:32.523051431 (14h57m46.515086854s) [upload=15450]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 30.263835159s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 657.536352ms remote: "tcp:3.109.243.18:443" response headers: Content-Length=166 Cf-Ray=976a75204b1f3ad7-BOM Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 07:50:27 GMT Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Cache-Control=private Set-Cookie=_cfuvid=bN1Chi7YZUwQtx1aqUYfC.grcIdOfzwSQuvdIdYEdwQ-1756453827008-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red Content-Type=text/html target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:50:27 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 657.561369ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 587.067211ms remote: "tcp:3.109.243.18:443" response headers: Date=Fri, 29 Aug 2025 07:50:18 GMT Content-Type=text/html Cf-Cache-Status=HIT Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Surrogate-Control=max-age=2147483647 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Vary=Accept-Encoding Set-Cookie=_cfuvid=g4l6azbhAgJli8ujHw_3O5KsQIPtkyOOJzB9uSWltf8-1756453818715-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Cf-Ray=976a74eebdce84ef-BOM Age=218703 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/ FAIL (2025-08-29 07:50:18 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 587.090356ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [..........................XXXX.......XXXXXXXXXXXXXXXXXXXXXXX] duration: 30.254612653s FAIL (2025-08-29 07:50:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== .764088574 (14h56m46.756123997s) [noise=true , address=77.90.31.18:4807 , piece_id=ILCOJFECFGVW6GIMANQHEP6R4GS3FP3EUJ7JUVXFSRRIJ2ISZS3A, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.764129802 (14h56m46.756165225s) [noise=true , address=45.91.116.4:4938 , piece_id=2GPZ7PBTWVUJXQJQAWQTT4E2UCSHEC3IIAO26ENOVHHMMEV7IWEQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.764492926 (14h56m46.75652835s) [noise=true , address=45.91.116.14:4189 , piece_id=GRIN3HPUJJOQXBWFRVQSBFZEMSYNWQG2ML3TFB4WNLGDDSYQWPCQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.764624308 (14h56m46.756659731s) [noise=true , address=104.36.82.15:4257 , piece_id=MUG7GZTM3XQ7AFDYAP7PXJBNQUULDPSGQWVL2LC5NYP5TKJXY6XQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.764775147 (14h56m46.75681056s) [noise=true , address=104.36.82.7:4910 , piece_id=Q3VP4LX4ZGUWSQ4L4YTFBNFS3RKB7ZXEQQ4HJBUI2ATUNZMKBE3A, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.765030245 (14h56m46.757065668s) [noise=true , address=45.91.116.5:4299 , piece_id=I6KL3XMKFJDIJBQU33YDYQM26COY4A4EBULACC7YO6FIOPQHCFAQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.765332754 (14h56m46.757368177s) [noise=true , address=45.91.116.12:4226 , piece_id=2KO6ORKBFVI2DCUQTPN3JJMGNBP45JELHKYI6T4DGSKXHIYP64IA, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.765544379 (14h56m46.757579802s) [noise=true , address=77.90.31.18:4805 , piece_id=IOBN7HD55BDMMP3LJ6PQ6CW7FHVIDBKGSPGOSKEQY2IJ4WQG7LWA, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.765609193 (14h56m46.757644616s) [noise=true , address=77.90.31.12:4590 , piece_id=SV6A2M5CEK226TSS763HIGN7FVKKY6VXPL2PEEICWVJKYDFJRXEQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.765935327 (14h56m46.75797075s) [noise=true , address=45.91.116.7:4011 , piece_id=JYM6HMCUIRMCBDJ2Y22ZSHBS6MEOIT2DO2PA7BSV3Q24MM4NAITQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.766173563 (14h56m46.758208986s) [noise=true , address=77.90.31.13:4628 , piece_id=DRA4RHTDYDEA4VEHSJYXRJDFPMVFYDETKJNO3XFQRQEL6G6W2U6Q, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.766421668 (14h56m46.758457091s) [noise=true , address=45.91.116.8:4047 , piece_id=NR7ECTDW6X6BWET4TCCNRZVVAHZQIIEQFX7WJ4GHQBMTYTNDDFPQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.766701443 (14h56m46.758736866s) [noise=true , address=104.36.82.12:4151 , piece_id=VS75F52IBKR3YE7OJQ35ZLOVFWYRRSUQ4Y2N52OLTHB2NLJA2OEQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.766786936 (14h56m46.758822359s) [noise=true , address=45.91.116.6:4973 , piece_id=UPGEYKWDR2IRHV4RLLODBBHUALNT5EQF3CVBFCCOLXMTTXJWSXQA, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.767023419 (14h56m46.759058842s) [noise=true , address=45.91.116.6:4974 , piece_id=RVFRLYA6A7OJCOB5IRWYYRE32LH2564XPRX7TW6L4BWST2K3LXJQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:32.767178164 (14h56m46.759213588s) [noise=true , address=104.36.82.9:4007 , piece_id=FE7U4LJYW77IOUM5REC6YSQ7E6D47FRPJR2EOD76HMIESAFNVFDQ, seg_pos={0 0}, upload=15440]: Uploading piece... Aug 29 07:49:34.584674743 (14h56m48.576710166s) [upload=15440]: Next returned nil segment Aug 29 07:49:34.584689000 (14h56m48.576724423s) [upload=15440]: Waiting for error group managing segments... Aug 29 07:49:34.873622890 (14h56m48.865658303s) [noise=true , address=45.91.116.5:4299 , piece_id=I6KL3XMKFJDIJBQU33YDYQM26COY4A4EBULACC7YO6FIOPQHCFAQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:34.974386075 (14h56m48.966421499s) [noise=true , address=104.36.82.9:4007 , piece_id=FE7U4LJYW77IOUM5REC6YSQ7E6D47FRPJR2EOD76HMIESAFNVFDQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:34.993599328 (14h56m48.985634762s) [noise=true , address=45.91.116.8:4047 , piece_id=NR7ECTDW6X6BWET4TCCNRZVVAHZQIIEQFX7WJ4GHQBMTYTNDDFPQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:35.131604294 (14h56m49.123639707s) [noise=true , address=77.90.31.12:4590 , piece_id=SV6A2M5CEK226TSS763HIGN7FVKKY6VXPL2PEEICWVJKYDFJRXEQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:37.787207155 (14h56m51.779242578s) [noise=true , address=104.36.82.15:4257 , piece_id=MUG7GZTM3XQ7AFDYAP7PXJBNQUULDPSGQWVL2LC5NYP5TKJXY6XQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:37.818606656 (14h56m51.810642069s) [noise=true , address=77.90.31.13:4628 , piece_id=DRA4RHTDYDEA4VEHSJYXRJDFPMVFYDETKJNO3XFQRQEL6G6W2U6Q, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:40.279697590 (14h56m54.271733013s) [noise=true , address=77.90.31.18:4805 , piece_id=IOBN7HD55BDMMP3LJ6PQ6CW7FHVIDBKGSPGOSKEQY2IJ4WQG7LWA, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:56.766877227 (14h57m10.75891265s) [noise=true , address=45.91.116.6:4973 , piece_id=UPGEYKWDR2IRHV4RLLODBBHUALNT5EQF3CVBFCCOLXMTTXJWSXQA, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:49:59.738955122 (14h57m13.730990535s) [noise=true , address=45.91.116.6:4974 , piece_id=RVFRLYA6A7OJCOB5IRWYYRE32LH2564XPRX7TW6L4BWST2K3LXJQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: <nil> Aug 29 07:50:01.777795747 (14h57m15.76983117s) [noise=true , address=104.36.82.12:4151 , piece_id=VS75F52IBKR3YE7OJQ35ZLOVFWYRRSUQ4Y2N52OLTHB2NLJA2OEQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:104.36.82.12:4151): protocol: write tcp 188.166.225.170:54372->104.36.82.12:4151: use of closed network connection; write tcp 188.166.225.170:54372->104.36.82.12:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54372->104.36.82.12:4151: use of closed network connection Aug 29 07:50:01.777894557 (14h57m15.76992999s) [noise=true , address=77.90.31.18:4807 , piece_id=ILCOJFECFGVW6GIMANQHEP6R4GS3FP3EUJ7JUVXFSRRIJ2ISZS3A, seg_pos={0 0}, upload=15440]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:54938->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:54938->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54938->77.90.31.18:4807: use of closed network connection Aug 29 07:50:01.777948269 (14h57m15.769983702s) [noise=true , address=45.91.116.12:4226 , piece_id=2KO6ORKBFVI2DCUQTPN3JJMGNBP45JELHKYI6T4DGSKXHIYP64IA, seg_pos={0 0}, upload=15440]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:48114->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:48114->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48114->45.91.116.12:4226: use of closed network connection Aug 29 07:50:01.777999107 (14h57m15.77003453s) [noise=true , address=45.91.116.7:4011 , piece_id=JYM6HMCUIRMCBDJ2Y22ZSHBS6MEOIT2DO2PA7BSV3Q24MM4NAITQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:34416->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:34416->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34416->45.91.116.7:4011: use of closed network connection Aug 29 07:50:01.778028824 (14h57m15.770064247s) [noise=true , address=45.91.116.14:4189 , piece_id=GRIN3HPUJJOQXBWFRVQSBFZEMSYNWQG2ML3TFB4WNLGDDSYQWPCQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:54166->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:54166->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54166->45.91.116.14:4189: use of closed network connection Aug 29 07:50:01.778052830 (14h57m15.770088263s) [noise=true , address=104.36.82.7:4910 , piece_id=Q3VP4LX4ZGUWSQ4L4YTFBNFS3RKB7ZXEQQ4HJBUI2ATUNZMKBE3A, seg_pos={0 0}, upload=15440]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:104.36.82.7:4910): protocol: write tcp 188.166.225.170:49140->104.36.82.7:4910: use of closed network connection; write tcp 188.166.225.170:49140->104.36.82.7:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49140->104.36.82.7:4910: use of closed network connection Aug 29 07:50:01.778094048 (14h57m15.770129481s) [noise=true , address=45.91.116.4:4938 , piece_id=2GPZ7PBTWVUJXQJQAWQTT4E2UCSHEC3IIAO26ENOVHHMMEV7IWEQ, seg_pos={0 0}, upload=15440]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:33204->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:50:01.778132622 (14h57m15.770168065s) [seg_pos={0 0}, upload=15440]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Aug 29 07:50:02.030158740 (14h57m16.022194173s) [upload=15440]: Done uploading segments... Aug 29 07:50:02.030198457 (14h57m16.02223388s) [upload=15440]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.254640908s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 20 out of 60 is failed (threshold=3) [.................................XX.......XXXXXXXXXXXXXXXXXX] duration: 1m0.265680454s FAIL (2025-08-29 07:50:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 9) ======LOGS====== ue , address=104.36.82.23:4460 , piece_id=LKAKFQUYM3T4EMBLHLYZMRS6INKGTRY4HZHQRTJ3YJON776BOWQA, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.806703763 (14h56m16.798739186s) [noise=true , address=77.90.31.21:4907 , piece_id=FQOBOFV6JO2U2ITCXZMFKCKSNAY7FEFAGGYRJCB4ZCQ2I5NB6KOQ, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.806863960 (14h56m16.798899383s) [noise=true , address=77.90.31.19:4850 , piece_id=VZVNRMAOLARWTAXF6J7VERXCGGM56LJHXZSZAONX3447MXKOFBFA, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.807006512 (14h56m16.799041935s) [noise=true , address=45.91.116.6:4990 , piece_id=PJ4LXETULVUW5XCZ3STSNS62AQEBUPLWIGEMIFSY7TC4OCEJIOEQ, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.807248095 (14h56m16.799283518s) [noise=true , address=79.127.205.246:4286 , piece_id=H2GI5JP3K5CF6YX6TCKFD4WNFD5LDPWJRQURHQZPPREXI7ZG7AWA, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.807267152 (14h56m16.799302585s) [noise=true , address=77.90.31.17:4777 , piece_id=KI3KTMAIEYHGZI64RGPZ7POWVAGONRNWRQDK3BM5PGQBLUN7QZ7Q, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.807561365 (14h56m16.799596818s) [noise=true , address=79.127.219.48:4101 , piece_id=ICD26VA3EHJK5XK7VQ4Z65KAJ3RUHUIGFASJOWESRHUNCHQ5ONDQ, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.807652860 (14h56m16.799688293s) [noise=true , address=104.36.82.48:4596 , piece_id=L2AFKPCM2BPOY7KYDNTLMDDQXBNU7TXBFCFSDSA437YRJTA5GEAA, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.807942153 (14h56m16.799977577s) [noise=true , address=45.91.116.11:4146 , piece_id=7G7IVD6EEET573DEMNDP5Q3DMCIDLSH2TPHQEW6RZAFUTTDM2NDQ, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.808041864 (14h56m16.800077297s) [noise=true , address=77.90.31.13:4634 , piece_id=OVVQ2F2QRSBIWBY65VFBRWJ2OWLHVTCXHLNCYNHKKNIUSSKBH7XA, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.808433223 (14h56m16.800468656s) [noise=true , address=45.91.116.7:4040 , piece_id=SYD4DVWMMRNZKDHX75XPMGQ4V3PJWSN23LETTGCE27BPFPGNVBPQ, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.808811807 (14h56m16.80084723s) [noise=true , address=77.90.31.10:4530 , piece_id=IGEN4H7EP42WL5GIDQM3OXMUAF5TYWLZ4SDGFJO7RN4Q6KMV7VIA, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:02.811372477 (14h56m16.8034079s) [noise=true , address=77.90.31.11:4583 , piece_id=XCLUSANB7BVC4CPUWUJJEM6RDSUBVC4U5ANANRS5BBJOR6S7R7RQ, seg_pos={0 0}, upload=15437]: Uploading piece... Aug 29 07:49:03.931224165 (14h56m17.923259588s) [upload=15437]: Next returned nil segment Aug 29 07:49:03.931242010 (14h56m17.923277433s) [upload=15437]: Waiting for error group managing segments... Aug 29 07:49:04.216840509 (14h56m18.208875932s) [noise=true , address=79.127.205.245:4219 , piece_id=GYRTKNMAL5ORDXFSBOVGDCWPMXTZUE6WGB7ZDUOKPCGLFJN2A77A, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:04.334353153 (14h56m18.326388576s) [noise=true , address=79.127.205.246:4286 , piece_id=H2GI5JP3K5CF6YX6TCKFD4WNFD5LDPWJRQURHQZPPREXI7ZG7AWA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:04.673479243 (14h56m18.665514696s) [noise=true , address=79.127.219.48:4101 , piece_id=ICD26VA3EHJK5XK7VQ4Z65KAJ3RUHUIGFASJOWESRHUNCHQ5ONDQ, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:04.779719748 (14h56m18.771755171s) [noise=true , address=77.90.31.11:4583 , piece_id=XCLUSANB7BVC4CPUWUJJEM6RDSUBVC4U5ANANRS5BBJOR6S7R7RQ, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:04.921324553 (14h56m18.913359976s) [noise=true , address=77.90.31.19:4850 , piece_id=VZVNRMAOLARWTAXF6J7VERXCGGM56LJHXZSZAONX3447MXKOFBFA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:05.368279066 (14h56m19.360314489s) [noise=true , address=104.36.82.48:4596 , piece_id=L2AFKPCM2BPOY7KYDNTLMDDQXBNU7TXBFCFSDSA437YRJTA5GEAA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:08.395786390 (14h56m22.387821813s) [noise=true , address=77.90.31.13:4634 , piece_id=OVVQ2F2QRSBIWBY65VFBRWJ2OWLHVTCXHLNCYNHKKNIUSSKBH7XA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:13.953419800 (14h56m27.945455223s) [noise=true , address=45.91.116.4:4945 , piece_id=TMJPZLUTXNJQCNDUWL3ZDB7DFOYCNW3BJ2QLRPVF4BFSM4E4TJQA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:49:17.243728431 (14h56m31.235763854s) [noise=true , address=45.91.116.6:4990 , piece_id=PJ4LXETULVUW5XCZ3STSNS62AQEBUPLWIGEMIFSY7TC4OCEJIOEQ, seg_pos={0 0}, upload=15437]: Done uploading piece. err: <nil> Aug 29 07:50:01.543225389 (14h57m15.535260812s) [noise=true , address=45.91.116.10:4096 , piece_id=IYJQ4X6KJ42OK5L62JFLXGMFEWXMV4UWJOIAZIIBMZ6DY67J3SHA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 188.166.225.170:42850->45.91.116.10:4096: use of closed network connection; write tcp 188.166.225.170:42850->45.91.116.10:4096: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42850->45.91.116.10:4096: use of closed network connection Aug 29 07:50:01.543297667 (14h57m15.53533309s) [noise=true , address=45.91.116.13:4168 , piece_id=KZWGDOPQ6R7XRRWYP24QTO2CT7SRCMWPP7S4VNOVOEHK3ZIMCYTA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:12CqtCR6R1o8wyteG2sLVScundbtjyEgouMLY64KTeoqFHwRtey, address:45.91.116.13:4168): protocol: write tcp 188.166.225.170:46364->45.91.116.13:4168: use of closed network connection; write tcp 188.166.225.170:46364->45.91.116.13:4168: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46364->45.91.116.13:4168: use of closed network connection Aug 29 07:50:01.543338725 (14h57m15.535374159s) [noise=true , address=77.90.31.17:4777 , piece_id=KI3KTMAIEYHGZI64RGPZ7POWVAGONRNWRQDK3BM5PGQBLUN7QZ7Q, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:1DjhLCRQRkNECPQg8HG8kZcBn8jJmBZpNhdywxEK7ZUn1v19wM, address:77.90.31.17:4777): protocol: write tcp 188.166.225.170:48032->77.90.31.17:4777: use of closed network connection; write tcp 188.166.225.170:48032->77.90.31.17:4777: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48032->77.90.31.17:4777: use of closed network connection Aug 29 07:50:01.543398600 (14h57m15.535434023s) [noise=true , address=45.91.116.11:4146 , piece_id=7G7IVD6EEET573DEMNDP5Q3DMCIDLSH2TPHQEW6RZAFUTTDM2NDQ, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp, address:45.91.116.11:4146): protocol: write tcp 188.166.225.170:48526->45.91.116.11:4146: use of closed network connection; write tcp 188.166.225.170:48526->45.91.116.11:4146: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48526->45.91.116.11:4146: use of closed network connection Aug 29 07:50:01.543567654 (14h57m15.535603087s) [noise=true , address=77.90.31.10:4530 , piece_id=IGEN4H7EP42WL5GIDQM3OXMUAF5TYWLZ4SDGFJO7RN4Q6KMV7VIA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:127c4HGgJu3z16vxq7TYZydCUa86FhCc3TmoPZoheVeqTbnJfne, address:77.90.31.10:4530): protocol: read tcp 188.166.225.170:43610->77.90.31.10:4530: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:50:01.543606929 (14h57m15.535642352s) [noise=true , address=45.91.116.7:4040 , piece_id=SYD4DVWMMRNZKDHX75XPMGQ4V3PJWSN23LETTGCE27BPFPGNVBPQ, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: read tcp 188.166.225.170:56290->45.91.116.7:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:50:01.543641104 (14h57m15.535676527s) [noise=true , address=104.36.82.23:4460 , piece_id=LKAKFQUYM3T4EMBLHLYZMRS6INKGTRY4HZHQRTJ3YJON776BOWQA, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: read tcp 188.166.225.170:42984->104.36.82.23:4460: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:50:01.543761234 (14h57m15.535796668s) [noise=true , address=77.90.31.21:4907 , piece_id=FQOBOFV6JO2U2ITCXZMFKCKSNAY7FEFAGGYRJCB4ZCQ2I5NB6KOQ, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:12RCGnjZC1UT9SUmFirNhS9pRBtxjcy91ss7c3Mk2kKnnHn2F6s, address:77.90.31.21:4907): protocol: read tcp 188.166.225.170:52482->77.90.31.21:4907: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:50:01.543921291 (14h57m15.535956724s) [noise=true , address=104.36.82.8:4979 , piece_id=UQWE4VNBLGV3HPN2SEBTN2KG3SQ37IJ7LLV6URBNBXJWZUJ22D6A, seg_pos={0 0}, upload=15437]: Done uploading piece. err: ecclient: upload failed (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC, address:104.36.82.8:4979): protocol: read tcp 188.166.225.170:49980->104.36.82.8:4979: use of closed network connection; context deadline exceeded Aug 29 07:50:01.543965665 (14h57m15.536001098s) [seg_pos={0 0}, upload=15437]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil> Aug 29 07:50:01.806540629 (14h57m15.798576072s) [upload=15437]: Done uploading segments... Aug 29 07:50:01.806594613 (14h57m15.798630046s) [upload=15437]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9) Duration: 1m0.265697195s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 605.617959ms remote: "tcp:13.203.125.58:443" response headers: Content-Type=text/html Content-Length=166 Location=https://static.storj.io/dcs-satellites Cf-Cache-Status=BYPASS Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Date=Fri, 29 Aug 2025 07:49:40 GMT Cf-Ray=976a74009cd24728-BOM Cache-Control=private Set-Cookie=_cfuvid=2n2RZz7M44LerRphRb6V_p40bRlMaKjUgvVoDaoDWMU-1756453780931-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-29 07:49:40 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 605.638768ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 355.411171ms remote: "tcp:3.109.243.18:443" response headers: Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:49:36 GMT Cf-Ray=976a73e80dc80ac9-BOM Cf-Cache-Status=HIT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e Set-Cookie=_cfuvid=VprAnvdJKWXjiPee5j9tlZ1tVCNLguLjtXWpedIQBKw-1756453776681-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Age=218540 Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html target: https://www.storj.io/ FAIL (2025-08-29 07:49:36 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 355.450506ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 20 out of 60 is failed (threshold=3) [................................XX........XXXXXXXXXXXXXXXXXX] duration: 1m0.251741508s FAIL (2025-08-29 07:49:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 4) ======LOGS====== Aug 29 07:48:30.234079555 (14h55m44.226114978s) [upload=15426]: Starting upload Aug 29 07:48:30.234124370 (14h55m44.226159793s) [upload=15426]: Done starting upload Aug 29 07:48:30.234221065 (14h55m44.226256538s) [upload=15426]: Uploading segments... Aug 29 07:48:30.234326026 (14h55m44.226361449s) [upload=15426]: Got next segment. Inline: false Aug 29 07:48:30.234394417 (14h55m44.22642984s) [upload=15426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 29 07:48:30.234399156 (14h55m44.226434579s) [upload=15426]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 29 07:48:30.737600629 (14h55m44.729636052s) [seg_pos={0 0}, upload=15426]: Begin upload segment... Aug 29 07:48:30.737645154 (14h55m44.729680577s) [seg_pos={0 0}, upload=15426]: Done begin upload segment. Aug 29 07:48:30.737668178 (14h55m44.729703591s) [noise=true , address=104.36.82.60:4369 , piece_id=ZN53TRIXIVRNIJHRPN4QJNY4G5L4Y2DR3C6GC5GP7IKLDBEQA7ZA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.737706040 (14h55m44.729741453s) [noise=true , address=104.36.82.54:4190 , piece_id=Y4O7IO2E5WM344CSOAO2T4LIEXOU3V23DSAPUIUH4X7FP3ES564Q, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.738086238 (14h55m44.730121661s) [noise=true , address=45.91.116.7:4019 , piece_id=BDJQTW2F2VNBUV7HBLVTDCJ54E6LPHMLO2RYS43WLJZ2BV2TQTMQ, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.738226396 (14h55m44.730261819s) [noise=true , address=104.36.82.42:4810 , piece_id=L65JSOST3QY336GKQIHOFQZ73UOKTR64Q5IPVLNOBDTRPIL2RLLA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.738559494 (14h55m44.730594917s) [noise=true , address=77.90.31.21:4893 , piece_id=BRJOVCY5H24NOTKCSNAOAMKWITE6YIOYDZO5C6HFIGIVCSWS7RDQ, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.738570474 (14h55m44.730605897s) [noise=true , address=77.90.31.10:4533 , piece_id=6BHBKLU2SJWO22HYYBGMW5L3UWM3OVHGGQRM6G2S42VAJOJHILDA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.738877973 (14h55m44.730913406s) [noise=true , address=45.91.116.6:4999 , piece_id=CFFD3KNRARVCLNXDQUFHJN5KZ7GXTCC7TAX2LZ6DQBUNLT4XO6HQ, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.739006819 (14h55m44.731042242s) [noise=true , address=45.91.116.12:4257 , piece_id=GFXIK23FFGP67AHQS7OZHNG7WKOCBE5WSYYL5CZA53MM5WBDWMKQ, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.739157517 (14h55m44.73119294s) [noise=true , address=77.90.31.11:4562 , piece_id=INFZ3BUW3WJGBLO2BMSGJFSIEJKZ2ILJBCUM3IBF4SJE3Q2XOSQQ, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.739410893 (14h55m44.731446306s) [noise=true , address=104.36.82.48:4596 , piece_id=WUVHDHWNEVX7GWDU6FL4CVCHMUFEVDIY4OJ5OCMF354AB6VH5OTA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.739499612 (14h55m44.731535035s) [noise=true , address=77.90.31.13:4652 , piece_id=WQVFHBE34VFICQJGB4ZIY3F3BN6YNX6PPIRC6CICQUPFWPSN7LOA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.739650490 (14h55m44.731685914s) [noise=true , address=77.90.31.12:4609 , piece_id=KKEGZ3H3VSMRQXQYUV7PE7DVUBYD3MX56HQGUHRNX6OO3OVFIGGA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.740020709 (14h55m44.732056132s) [noise=true , address=77.90.31.17:4769 , piece_id=7ZOYK2EKIYZRZOAE5P52IK4GSASLL6H2M3U6M7F3DX7J4JN6RW4A, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.740412819 (14h55m44.732448242s) [noise=true , address=45.91.116.13:4162 , piece_id=G6F2XJRRHHD5SA4GOPE4GDUZJH5RXNHCKPIIZLTIKFAADVG2UFPQ, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.740768921 (14h55m44.732804344s) [noise=true , address=77.90.31.15:4721 , piece_id=TDLDU2SCJIUGM4V7JMZYH4JEBIDBDFSCE7ZMAE3NTARBUMKK2VZA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.741087431 (14h55m44.733122854s) [noise=true , address=45.91.116.4:4958 , piece_id=HJPCHFZBZ3VXFGOCZFGC2DOOHM32H7CV3NEPR55RDUSABYSGEFTQ, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.742022750 (14h55m44.734058173s) [noise=true , address=45.91.116.10:4096 , piece_id=OR6XIAZSLLWJ4QXZIYE3ATYPJWDOK5UVOZTNCDJJIFACSTC7ZXDA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:30.742316663 (14h55m44.734352086s) [noise=true , address=77.90.31.18:4820 , piece_id=GMZ3W6FFCFZRD3Y6C2A7YD45UU3HUKSNVUERLGLZJSAE2O7DYXGA, seg_pos={0 0}, upload=15426]: Uploading piece... Aug 29 07:48:32.290666414 (14h55m46.282701837s) [upload=15426]: Next returned nil segment Aug 29 07:48:32.290684329 (14h55m46.282719752s) [upload=15426]: Waiting for error group managing segments... Aug 29 07:48:32.691834030 (14h55m46.683869453s) [noise=true , address=77.90.31.10:4533 , piece_id=6BHBKLU2SJWO22HYYBGMW5L3UWM3OVHGGQRM6G2S42VAJOJHILDA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: <nil> Aug 29 07:48:32.841722084 (14h55m46.833757507s) [noise=true , address=77.90.31.11:4562 , piece_id=INFZ3BUW3WJGBLO2BMSGJFSIEJKZ2ILJBCUM3IBF4SJE3Q2XOSQQ, seg_pos={0 0}, upload=15426]: Done uploading piece. err: <nil> Aug 29 07:48:36.902253700 (14h55m50.894289123s) [noise=true , address=104.36.82.60:4369 , piece_id=ZN53TRIXIVRNIJHRPN4QJNY4G5L4Y2DR3C6GC5GP7IKLDBEQA7ZA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: <nil> Aug 29 07:48:37.666261951 (14h55m51.658297374s) [noise=true , address=104.36.82.42:4810 , piece_id=L65JSOST3QY336GKQIHOFQZ73UOKTR64Q5IPVLNOBDTRPIL2RLLA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: <nil> Aug 29 07:49:29.515419429 (14h56m43.507454852s) [noise=true , address=77.90.31.18:4820 , piece_id=GMZ3W6FFCFZRD3Y6C2A7YD45UU3HUKSNVUERLGLZJSAE2O7DYXGA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:12bFT8wMeMrsm5byCeSjJQQUXCWmDtyBqiiu1KqpXMoxTHAakV9, address:77.90.31.18:4820): protocol: write tcp 188.166.225.170:43780->77.90.31.18:4820: use of closed network connection; write tcp 188.166.225.170:43780->77.90.31.18:4820: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43780->77.90.31.18:4820: use of closed network connection Aug 29 07:49:29.515528748 (14h56m43.507564161s) [noise=true , address=45.91.116.6:4999 , piece_id=CFFD3KNRARVCLNXDQUFHJN5KZ7GXTCC7TAX2LZ6DQBUNLT4XO6HQ, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB, address:45.91.116.6:4999): protocol: write tcp 188.166.225.170:40438->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:40438->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40438->45.91.116.6:4999: use of closed network connection Aug 29 07:49:29.515675488 (14h56m43.507710911s) [noise=true , address=45.91.116.4:4958 , piece_id=HJPCHFZBZ3VXFGOCZFGC2DOOHM32H7CV3NEPR55RDUSABYSGEFTQ, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:1PRN34y7cCWokJkxgu5Zk4eBjDPW5iddNefMKXvUkJUTAqkKve, address:45.91.116.4:4958): protocol: write tcp 188.166.225.170:47038->45.91.116.4:4958: use of closed network connection; write tcp 188.166.225.170:47038->45.91.116.4:4958: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47038->45.91.116.4:4958: use of closed network connection Aug 29 07:49:29.515914476 (14h56m43.507949899s) [noise=true , address=77.90.31.17:4769 , piece_id=7ZOYK2EKIYZRZOAE5P52IK4GSASLL6H2M3U6M7F3DX7J4JN6RW4A, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd, address:77.90.31.17:4769): protocol: write tcp 188.166.225.170:52920->77.90.31.17:4769: use of closed network connection; write tcp 188.166.225.170:52920->77.90.31.17:4769: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52920->77.90.31.17:4769: use of closed network connection Aug 29 07:49:29.515945365 (14h56m43.507980788s) [noise=true , address=45.91.116.13:4162 , piece_id=G6F2XJRRHHD5SA4GOPE4GDUZJH5RXNHCKPIIZLTIKFAADVG2UFPQ, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:1geUSD7qjW2yuMayTJ1Zy1KTYVC19adZ9nUWMRtmg2TktJSsm4, address:45.91.116.13:4162): protocol: read tcp 188.166.225.170:44354->45.91.116.13:4162: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.515978247 (14h56m43.50801367s) [noise=true , address=77.90.31.12:4609 , piece_id=KKEGZ3H3VSMRQXQYUV7PE7DVUBYD3MX56HQGUHRNX6OO3OVFIGGA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:1Ak8v5Vx9d87Q2CFqfJ5Nqu5Qp2rWMbgR8iqYvkYwpRVuZaAsV, address:77.90.31.12:4609): protocol: read tcp 188.166.225.170:34804->77.90.31.12:4609: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516007523 (14h56m43.508042946s) [noise=true , address=77.90.31.15:4721 , piece_id=TDLDU2SCJIUGM4V7JMZYH4JEBIDBDFSCE7ZMAE3NTARBUMKK2VZA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:1etuVthkhtZexvw7u88vxw2HGPaMwfYCbEgKWF4GPRh9FeWTwn, address:77.90.31.15:4721): protocol: read tcp 188.166.225.170:47252->77.90.31.15:4721: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516037420 (14h56m43.508072844s) [noise=true , address=45.91.116.7:4019 , piece_id=BDJQTW2F2VNBUV7HBLVTDCJ54E6LPHMLO2RYS43WLJZ2BV2TQTMQ, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm, address:45.91.116.7:4019): protocol: read tcp 188.166.225.170:55270->45.91.116.7:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516065334 (14h56m43.508100757s) [noise=true , address=45.91.116.12:4257 , piece_id=GFXIK23FFGP67AHQS7OZHNG7WKOCBE5WSYYL5CZA53MM5WBDWMKQ, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: read tcp 188.166.225.170:58704->45.91.116.12:4257: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516093598 (14h56m43.508129021s) [noise=true , address=77.90.31.13:4652 , piece_id=WQVFHBE34VFICQJGB4ZIY3F3BN6YNX6PPIRC6CICQUPFWPSN7LOA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA, address:77.90.31.13:4652): protocol: read tcp 188.166.225.170:49124->77.90.31.13:4652: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516122012 (14h56m43.508157435s) [noise=true , address=45.91.116.10:4096 , piece_id=OR6XIAZSLLWJ4QXZIYE3ATYPJWDOK5UVOZTNCDJJIFACSTC7ZXDA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: read tcp 188.166.225.170:45796->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516153183 (14h56m43.508188606s) [noise=true , address=104.36.82.54:4190 , piece_id=Y4O7IO2E5WM344CSOAO2T4LIEXOU3V23DSAPUIUH4X7FP3ES564Q, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:1eKHcxWuBbQAGX44kVrn9cfEhEcRpmQfQegcoMGjr92pfM1VVF, address:104.36.82.54:4190): protocol: read tcp 188.166.225.170:38354->104.36.82.54:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516181106 (14h56m43.508216529s) [noise=true , address=77.90.31.21:4893 , piece_id=BRJOVCY5H24NOTKCSNAOAMKWITE6YIOYDZO5C6HFIGIVCSWS7RDQ, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:1NgPjVCyZZAfxVr3WvKrGRjnkpPtUvmQcCMiYntxNKVSWqXcHC, address:77.90.31.21:4893): protocol: read tcp 188.166.225.170:47636->77.90.31.21:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516209541 (14h56m43.508244964s) [noise=true , address=104.36.82.48:4596 , piece_id=WUVHDHWNEVX7GWDU6FL4CVCHMUFEVDIY4OJ5OCMF354AB6VH5OTA, seg_pos={0 0}, upload=15426]: Done uploading piece. err: ecclient: upload failed (node:12uVgAqShxPQefEKUAZELdhDztRYA5Xqi8BjT3gwpa5QiEHk8Au, address:104.36.82.48:4596): protocol: read tcp 188.166.225.170:40232->104.36.82.48:4596: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 29 07:49:29.516222485 (14h56m43.508257908s) [seg_pos={0 0}, upload=15426]: Done waiting for segment. successful: 4 optimal: 14 errs: <nil> Aug 29 07:49:29.765746918 (14h56m43.757782341s) [upload=15426]: Done uploading segments... Aug 29 07:49:29.765778388 (14h56m43.757813811s) [upload=15426]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 4) Duration: 1m0.251756677s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 15 out of 15 is failed (threshold=6) [XXXXXXXXXXXXXXX] duration: 410.565107ms remote: "tcp:13.233.175.166:443" response headers: X-Cluster-Name=ap-south-1-prod-hosting-red Date=Fri, 29 Aug 2025 07:49:10 GMT Age=218589 Vary=Accept-Encoding Set-Cookie=_cfuvid=DrU8nPetyylSceIVzuBWvBsqRDiyFjdibutu.jAybCQ-1756453750385-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Cf-Ray=976a73435c0e3c76-BOM Cf-Cache-Status=HIT Surrogate-Control=max-age=2147483647 Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 Alt-Svc=h3=":443"; ma=86400 Content-Type=text/html Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e target: https://www.storj.io/ FAIL (2025-08-29 07:49:10 UTC) orbiter warning: no valid certificate chain appears to exist after 336h0m0s Duration: 410.586477ms core website

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)