Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.65855569s FAIL (2025-08-13 10:06:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.658582332s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.677654574s FAIL (2025-08-13 10:06:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.677681706s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X.................X.X......................X....X..] duration: 1.911468417s FAIL (2025-08-13 10:06:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:04:29.287006096 (112h38m23.718086227s) [upload=117228]: Starting upload Aug 13 10:04:29.287078776 (112h38m23.718158907s) [upload=117228]: Done starting upload Aug 13 10:04:29.287128531 (112h38m23.718208662s) [upload=117228]: Uploading segments... Aug 13 10:04:29.287165562 (112h38m23.718245683s) [upload=117228]: Got next segment. Inline: true Aug 13 10:04:29.287169539 (112h38m23.71824967s) [upload=117228]: Waiting for error group managing segments... Aug 13 10:04:29.287200950 (112h38m23.718281071s) [upload=117228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:04:29.287207232 (112h38m23.718287353s) [upload=117228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:04:29.287210338 (112h38m23.718290469s) [upload=117228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:04:29.503824723 (112h38m23.934904844s) [upload=117228]: Done uploading segments... Aug 13 10:04:29.503841464 (112h38m23.934921606s) [upload=117228]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.911505469s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.271275268s FAIL (2025-08-13 10:05:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.271296689s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.854937329s FAIL (2025-08-13 10:05:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.854960917s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.194720351s FAIL (2025-08-13 10:05:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.194737855s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........X.................X.X......................X....X.] duration: 1.839795557s FAIL (2025-08-13 10:04:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:04:29.287006096 (112h38m23.718086227s) [upload=117228]: Starting upload Aug 13 10:04:29.287078776 (112h38m23.718158907s) [upload=117228]: Done starting upload Aug 13 10:04:29.287128531 (112h38m23.718208662s) [upload=117228]: Uploading segments... Aug 13 10:04:29.287165562 (112h38m23.718245683s) [upload=117228]: Got next segment. Inline: true Aug 13 10:04:29.287169539 (112h38m23.71824967s) [upload=117228]: Waiting for error group managing segments... Aug 13 10:04:29.287200950 (112h38m23.718281071s) [upload=117228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:04:29.287207232 (112h38m23.718287353s) [upload=117228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:04:29.287210338 (112h38m23.718290469s) [upload=117228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:04:29.503824723 (112h38m23.934904844s) [upload=117228]: Done uploading segments... Aug 13 10:04:29.503841464 (112h38m23.934921606s) [upload=117228]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.839819584s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.592928709s FAIL (2025-08-13 10:04:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.592977201s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........X.................X.X......................X....X] duration: 872.799605ms FAIL (2025-08-13 10:04:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:04:29.287006096 (112h38m23.718086227s) [upload=117228]: Starting upload Aug 13 10:04:29.287078776 (112h38m23.718158907s) [upload=117228]: Done starting upload Aug 13 10:04:29.287128531 (112h38m23.718208662s) [upload=117228]: Uploading segments... Aug 13 10:04:29.287165562 (112h38m23.718245683s) [upload=117228]: Got next segment. Inline: true Aug 13 10:04:29.287169539 (112h38m23.71824967s) [upload=117228]: Waiting for error group managing segments... Aug 13 10:04:29.287200950 (112h38m23.718281071s) [upload=117228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:04:29.287207232 (112h38m23.718287353s) [upload=117228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:04:29.287210338 (112h38m23.718290469s) [upload=117228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:04:29.503824723 (112h38m23.934904844s) [upload=117228]: Done uploading segments... Aug 13 10:04:29.503841464 (112h38m23.934921606s) [upload=117228]: Upload finished. err: metaclient: Too Many Requests Duration:* 872.826156ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X.................X.X......................X....] duration: 1.84893171s FAIL (2025-08-13 10:04:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:01:18.801877925 (112h35m13.232958057s) [upload=117170]: Starting upload Aug 13 10:01:18.801926969 (112h35m13.2330071s) [upload=117170]: Done starting upload Aug 13 10:01:18.801988657 (112h35m13.233068788s) [upload=117170]: Uploading segments... Aug 13 10:01:18.802019977 (112h35m13.233100098s) [upload=117170]: Got next segment. Inline: true Aug 13 10:01:18.802023734 (112h35m13.233103865s) [upload=117170]: Waiting for error group managing segments... Aug 13 10:01:18.802057679 (112h35m13.23313781s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:01:18.802061666 (112h35m13.233141797s) [upload=117170]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:01:18.802064291 (112h35m13.233144422s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:01:19.015874050 (112h35m13.446954182s) [upload=117170]: Done uploading segments... Aug 13 10:01:19.015891594 (112h35m13.446971725s) [upload=117170]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.848958733s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.621512425s FAIL (2025-08-13 10:04:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.621537222s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.467499443s FAIL (2025-08-13 10:03:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.467962991s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.781895223s FAIL (2025-08-13 10:03:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.781922045s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X.................X.X......................X...] duration: 1.843440903s FAIL (2025-08-13 10:03:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:01:18.801877925 (112h35m13.232958057s) [upload=117170]: Starting upload Aug 13 10:01:18.801926969 (112h35m13.2330071s) [upload=117170]: Done starting upload Aug 13 10:01:18.801988657 (112h35m13.233068788s) [upload=117170]: Uploading segments... Aug 13 10:01:18.802019977 (112h35m13.233100098s) [upload=117170]: Got next segment. Inline: true Aug 13 10:01:18.802023734 (112h35m13.233103865s) [upload=117170]: Waiting for error group managing segments... Aug 13 10:01:18.802057679 (112h35m13.23313781s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:01:18.802061666 (112h35m13.233141797s) [upload=117170]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:01:18.802064291 (112h35m13.233144422s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:01:19.015874050 (112h35m13.446954182s) [upload=117170]: Done uploading segments... Aug 13 10:01:19.015891594 (112h35m13.446971725s) [upload=117170]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.843463848s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.77488033s FAIL (2025-08-13 10:03:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.77491184s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.198799798s FAIL (2025-08-13 10:03:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.19882289s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X.................X.X......................X..] duration: 1.924589623s FAIL (2025-08-13 10:02:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:01:18.801877925 (112h35m13.232958057s) [upload=117170]: Starting upload Aug 13 10:01:18.801926969 (112h35m13.2330071s) [upload=117170]: Done starting upload Aug 13 10:01:18.801988657 (112h35m13.233068788s) [upload=117170]: Uploading segments... Aug 13 10:01:18.802019977 (112h35m13.233100098s) [upload=117170]: Got next segment. Inline: true Aug 13 10:01:18.802023734 (112h35m13.233103865s) [upload=117170]: Waiting for error group managing segments... Aug 13 10:01:18.802057679 (112h35m13.23313781s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:01:18.802061666 (112h35m13.233141797s) [upload=117170]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:01:18.802064291 (112h35m13.233144422s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:01:19.015874050 (112h35m13.446954182s) [upload=117170]: Done uploading segments... Aug 13 10:01:19.015891594 (112h35m13.446971725s) [upload=117170]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.924614903s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.598343127s FAIL (2025-08-13 10:02:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.598376411s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X.................X.X......................X.] duration: 1.832275623s FAIL (2025-08-13 10:02:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:01:18.801877925 (112h35m13.232958057s) [upload=117170]: Starting upload Aug 13 10:01:18.801926969 (112h35m13.2330071s) [upload=117170]: Done starting upload Aug 13 10:01:18.801988657 (112h35m13.233068788s) [upload=117170]: Uploading segments... Aug 13 10:01:18.802019977 (112h35m13.233100098s) [upload=117170]: Got next segment. Inline: true Aug 13 10:01:18.802023734 (112h35m13.233103865s) [upload=117170]: Waiting for error group managing segments... Aug 13 10:01:18.802057679 (112h35m13.23313781s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:01:18.802061666 (112h35m13.233141797s) [upload=117170]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:01:18.802064291 (112h35m13.233144422s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:01:19.015874050 (112h35m13.446954182s) [upload=117170]: Done uploading segments... Aug 13 10:01:19.015891594 (112h35m13.446971725s) [upload=117170]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.83229997s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.284164815s FAIL (2025-08-13 10:01:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.284188011s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.531628734s FAIL (2025-08-13 10:01:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.531655355s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.72885258s FAIL (2025-08-13 10:01:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.728878269s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [................X.................X.X......................X] duration: 862.90941ms FAIL (2025-08-13 10:01:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:01:18.801877925 (112h35m13.232958057s) [upload=117170]: Starting upload Aug 13 10:01:18.801926969 (112h35m13.2330071s) [upload=117170]: Done starting upload Aug 13 10:01:18.801988657 (112h35m13.233068788s) [upload=117170]: Uploading segments... Aug 13 10:01:18.802019977 (112h35m13.233100098s) [upload=117170]: Got next segment. Inline: true Aug 13 10:01:18.802023734 (112h35m13.233103865s) [upload=117170]: Waiting for error group managing segments... Aug 13 10:01:18.802057679 (112h35m13.23313781s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 10:01:18.802061666 (112h35m13.233141797s) [upload=117170]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 10:01:18.802064291 (112h35m13.233144422s) [upload=117170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 10:01:19.015874050 (112h35m13.446954182s) [upload=117170]: Done uploading segments... Aug 13 10:01:19.015891594 (112h35m13.446971725s) [upload=117170]: Upload finished. err: metaclient: Too Many Requests Duration:* 862.931382ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.820854037s FAIL (2025-08-13 10:00:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.820963737s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.027693739s FAIL (2025-08-13 10:00:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.027714628s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X.................X.X......................] duration: 1.897500351s FAIL (2025-08-13 10:00:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.897528324s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.629795216s FAIL (2025-08-13 10:00:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.629818841s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X.................X.X.....................] duration: 1.893069128s FAIL (2025-08-13 09:59:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.893235137s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.890130602s FAIL (2025-08-13 09:59:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.890167643s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.928431115s FAIL (2025-08-13 09:59:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.928452755s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X.................X.X....................] duration: 1.863276175s FAIL (2025-08-13 09:59:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.8633042s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.451422831s FAIL (2025-08-13 09:59:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.451447879s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.676810389s FAIL (2025-08-13 09:58:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.676860645s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000564734s FAIL (2025-08-13 09:58:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000589552s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X.................X.X...................] duration: 1.894134326s FAIL (2025-08-13 09:58:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.894160045s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.................X.X..................] duration: 1.89597047s FAIL (2025-08-13 09:58:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.89599678s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.606567554s FAIL (2025-08-13 09:58:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.606649361s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.703746189s FAIL (2025-08-13 09:57:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.703768352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.................X.X.................] duration: 1.853499479s FAIL (2025-08-13 09:57:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.853519076s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.................X.X................] duration: 1.845472983s FAIL (2025-08-13 09:56:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.845505274s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.852847288s FAIL (2025-08-13 09:56:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.852872606s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.................X.X...............] duration: 1.990554354s FAIL (2025-08-13 09:56:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.990580766s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.................X.X..............] duration: 1.822714077s FAIL (2025-08-13 09:55:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.822744376s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.802890417s FAIL (2025-08-13 09:55:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.802916997s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.................X.X.............] duration: 1.810066907s FAIL (2025-08-13 09:55:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.81008889s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.811705156s FAIL (2025-08-13 09:54:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.811728961s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.................X.X............] duration: 1.874634408s FAIL (2025-08-13 09:54:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.874660548s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X.................X.X...........] duration: 1.925756812s FAIL (2025-08-13 09:53:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0a1db541d6697b050afbcd810d73bfc54ad08f11c9f87d9335009fa6659d666d != before 009ceab0c7b720412900d357c61e381525a46f20fd95976b1c7ef6ccbce33f55 ======LOGS====== Aug 13 09:45:57.856383631 (112h19m52.287463762s) [upload=116893]: Starting upload Aug 13 09:45:57.856421593 (112h19m52.287501724s) [upload=116893]: Done starting upload Aug 13 09:45:57.856470557 (112h19m52.287550688s) [upload=116893]: Uploading segments... Aug 13 09:45:57.856505634 (112h19m52.287585765s) [upload=116893]: Got next segment. Inline: true Aug 13 09:45:57.856509411 (112h19m52.287589542s) [upload=116893]: Waiting for error group managing segments... Aug 13 09:45:57.856541393 (112h19m52.287621524s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:45:57.856545802 (112h19m52.287625933s) [upload=116893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 09:45:57.856548256 (112h19m52.287639278s) [upload=116893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:45:58.130874319 (112h19m52.56195445s) [upload=116893]: Done uploading segments... Aug 13 09:45:58.130891613 (112h19m52.561971744s) [upload=116893]: Upload finished. err: <nil> Duration:* 1.925784425s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.637420246s FAIL (2025-08-13 09:53:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.637457135s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.699830618s FAIL (2025-08-13 09:52:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 09:27:27.401212365 (112h1m21.832292496s) [upload=116570]: Starting upload Aug 13 09:27:27.401257591 (112h1m21.832337712s) [upload=116570]: Done starting upload Aug 13 09:27:27.401336612 (112h1m21.832416743s) [upload=116570]: Uploading segments... Aug 13 09:27:27.401489876 (112h1m21.832570007s) [upload=116570]: Got next segment. Inline: false Aug 13 09:27:27.401841769 (112h1m21.83292189s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 09:27:27.401847700 (112h1m21.832927831s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 09:27:27.859936182 (112h1m22.291016313s) [seg_pos={0 0}, upload=116570]: Begin upload segment... Aug 13 09:27:27.859982931 (112h1m22.291063062s) [seg_pos={0 0}, upload=116570]: Done begin upload segment. Aug 13 09:27:27.859998391 (112h1m22.291078512s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860006005 (112h1m22.291086136s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860358770 (112h1m22.291438901s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860650949 (112h1m22.29173108s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.860921015 (112h1m22.292001136s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861193747 (112h1m22.292273878s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861422305 (112h1m22.292502436s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861649730 (112h1m22.292729861s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.861899969 (112h1m22.29298009s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862136101 (112h1m22.293216232s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862382011 (112h1m22.293462142s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862597304 (112h1m22.293677425s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.862808056 (112h1m22.293888187s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863024971 (112h1m22.294105102s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863275961 (112h1m22.294356092s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863478540 (112h1m22.294558671s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863689643 (112h1m22.294769774s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:27.863953308 (112h1m22.295033429s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Uploading piece... Aug 13 09:27:29.048823466 (112h1m23.479903587s) [upload=116570]: Next returned nil segment Aug 13 09:27:29.048841060 (112h1m23.479921192s) [upload=116570]: Waiting for error group managing segments... Aug 13 09:27:29.356832966 (112h1m23.787913097s) [noise=true , address=66.23.193.175:4562 , piece_id=JWRZOOYF327TK36NFZITFKCNLQJJILEYHAGMMZQHWKI76MTOZMCQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.752766364 (112h1m24.183846495s) [noise=true , address=79.127.219.38:4013 , piece_id=UMBHJ6SIATOHFTFVNRDBMSYVOMEJTCP65PKQES3HZJZTUVM6UCZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.808733288 (112h1m24.239813419s) [noise=true , address=79.127.201.215:4358 , piece_id=KDRASU5BMAQLCCYPMBZOXRLX6WIV6IDPL4UV2VWIWA5UUDKRKMCA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.821180483 (112h1m24.252260615s) [noise=true , address=104.36.82.44:4871 , piece_id=HTP25IBKRORV5F2HS3CL6JZRH3UWNOZ7C7KB5EN7O6SRLZAL6DGQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.830713924 (112h1m24.261794095s) [noise=true , address=77.90.31.18:4833 , piece_id=3RAH3N6UX7JUQBMUA46UPXVSE24LX4RYU66EQMXFJZPRSVSRH3NA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.834535046 (112h1m24.265615177s) [noise=true , address=77.90.31.17:4797 , piece_id=PTJZBIYH3YGP6F3NOL6MJY6UVR3EW5TEPEFDSIK3CHF34ZNSOJ6A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.837486443 (112h1m24.268566614s) [noise=true , address=104.36.82.37:4679 , piece_id=666TAGXCQCIPNNEBZC3TDBQ5CMB5KDQGRGLV6KHDRMUSWURNUBKA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.847382116 (112h1m24.278462277s) [noise=true , address=104.36.82.34:4557 , piece_id=ADMUIILQI5GWMSLHMLNKO4VREWB2GIXL6MMW2CAJ535WWT7VJG2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.850768186 (112h1m24.281848317s) [noise=true , address=104.36.82.18:4375 , piece_id=OB7XN7C5APWY5SDT7I44BYDLHHKSWDPWJ57ZPDTOV72K5434VJOQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.856359723 (112h1m24.287439855s) [noise=true , address=77.90.31.16:4762 , piece_id=DDIAEN7O32ZZAJ7HPR5ELAKKLHQ6YSO536G2ESDHQLRE324OAK2Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.866285244 (112h1m24.297365375s) [noise=true , address=104.36.82.36:4634 , piece_id=MAWGHKCMFLCV2DMB4AFWLVILN35ITHFWNI5ZCE67NQBG44SIZASQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.867573168 (112h1m24.298653299s) [noise=true , address=77.90.31.16:4754 , piece_id=DAWYEDFGWRMOTOLKSNV4WVGUG3QUNQSE4IMKD3XTVQSS4HQHGT2A, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.923254416 (112h1m24.354334547s) [noise=true , address=104.36.82.60:4358 , piece_id=YTNM4GB4ORSN5T4GEC4BF3FQVV6NZHKFDXPE6ZRHHQ26O2X4KQZQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926738983 (112h1m24.357819115s) [noise=true , address=104.36.82.58:4277 , piece_id=F42DQHC3MANNTLHVDPHUCFSFMX5AWWCYFTFQ3ETB7UXPB2DPPSSQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: <nil> Aug 13 09:27:29.926768611 (112h1m24.357848742s) [seg_pos={0 0}, upload=116570]: Segment reached optimal threshold of 14 pieces. Aug 13 09:27:29.926959325 (112h1m24.358039456s) [noise=true , address=104.36.82.62:4427 , piece_id=63TW6BLD363HJGPTVOWMMDL6SAEFFLNWCQGKXBIS4RUXP5ZT7QNA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bx9fnLeXTPskzQB1Ad45qnq4CRivoGy7KXALY35dzVGF6S5Ep): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927002288 (112h1m24.358082419s) [noise=true , address=104.36.82.19:4417 , piece_id=MFQHF27ZXLNR5WWSOGIEJFOGXQ3IN26ACCVZSXHNM3WT5RYCT4ZA, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TKc4R7hmma2b59RP5Qs5SEw8ha8FECxfJyTdz7mq6jao1JTCK): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927033307 (112h1m24.358113438s) [noise=true , address=104.36.82.59:4311 , piece_id=SVO5YL3HUHYCZGDVV3QGEVQVXV27X7PW4G3QJAEBW5HXNRB2BXJQ, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bowY9sNioETZodrJQZF4P9evfk5fv82gT8nTEq3kvjMYi4buX): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927092901 (112h1m24.358173032s) [noise=true , address=104.36.82.23:4446 , piece_id=BJGFKKF5ZXOYRF5I73VJS6WLVHDBBRRK5SLGZVXG22ECENAAEY5Q, seg_pos={0 0}, upload=116570]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF Aug 13 09:27:29.927109994 (112h1m24.358190125s) [seg_pos={0 0}, upload=116570]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 09:27:29.927181431 (112h1m24.358261562s) [upload=116570]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 09:27:29.927186150 (112h1m24.358266281s) [upload=116570]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 09:27:30.236547034 (112h1m24.667627165s) [upload=116570]: Done uploading segments... Aug 13 09:27:30.236569136 (112h1m24.667649318s) [upload=116570]: Upload finished. err: <nil> Duration: 5.699856658s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)