Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X...................................XX...] duration: 12.62272322s FAIL (2025-07-26 21:35:54 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 12.622773868s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 1m0.231842322s FAIL (2025-07-26 21:35:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 26 21:34:50.590454602 (57h59m0.313017632s) [upload=55654]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:34:50.590461004 (57h59m0.313024044s) [upload=55654]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:34:51.058371196 (57h59m0.780934246s) [seg_pos={0 0}, upload=55654]: Begin upload segment... Jul 26 21:34:51.058434267 (57h59m0.780997307s) [seg_pos={0 0}, upload=55654]: Done begin upload segment. Jul 26 21:34:51.058457972 (57h59m0.781021002s) [noise=true , address=104.36.82.53:4153 , piece_id=JSITHZQHE7RIDILNYJHJ7MZ7MUWZ36BBIR3BAELBI4VCFEFQ5RPA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.058846295 (57h59m0.781409335s) [noise=true , address=104.36.82.13:4207 , piece_id=U527R2G4KOSDSHMWEA6ESAOPEURIWWZJKMXCZWFPEPHGTQYIV5DA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.058864099 (57h59m0.781427139s) [noise=true , address=104.36.82.7:4931 , piece_id=2XRG33HE2DQPM5KL3AW62TH6RCG2YJXUZDBO4ZEFKNPJ33TEGUSA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.059123064 (57h59m0.781686104s) [noise=true , address=104.36.82.22:4543 , piece_id=IGJC6PUCA64L5TIRPJV3CV7IL6JBSHSHRQR6HZCL6JKMOLYVXDEA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.059467123 (57h59m0.782030163s) [noise=true , address=104.36.82.43:4836 , piece_id=3C4X3INXPIU6PA24UENPXCYO6YPBLPO4UPF36KKGERHNQWQY2FWA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.059603033 (57h59m0.782166073s) [noise=true , address=104.36.82.52:4117 , piece_id=C4ARISN33TG2Z75ZM4P7YT6JGDT4TGQKBS7UD3V5WZ7YMAUWQFTA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.059763761 (57h59m0.782326811s) [noise=true , address=104.36.82.50:4034 , piece_id=EI2BZRKUT56RQSQ2SGJUQSL5U7Z5L6YLE3HRCAEDIO26IFVB27DQ, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.059853933 (57h59m0.782416963s) [noise=true , address=104.36.82.8:4994 , piece_id=JAHDAXDGSIS7FR64MT7MDSBNLCT4DWL5DC2TATNVPG56JMCDINDA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.060046662 (57h59m0.782609702s) [noise=true , address=104.36.82.54:4191 , piece_id=TXBLNZKAHWKERTGXU6HAD4INJ6N6XZE2SITWBN2L2SG42SC6X6SA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.060085175 (57h59m0.782648215s) [noise=true , address=104.36.82.54:4182 , piece_id=AM4TO7G5NVMEV2VBE5ZQZVPVCVU3PIBLG5WDUMC7LLTKL7MBAIYQ, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.060324063 (57h59m0.782887103s) [noise=true , address=79.127.205.233:4647 , piece_id=GOKF2BSQ4VBFD7WTL3QED3277S74X2CMWMEU3OMABNHIJ3ZDIX2Q, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.060343139 (57h59m0.782906169s) [noise=true , address=104.36.82.47:4518 , piece_id=JEC6O5EN2I453FWWGU43EE4YK5KWCXHVAMGFEMVP42JUDDSYLV3A, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.060561427 (57h59m0.783124467s) [noise=true , address=104.36.82.5:4860 , piece_id=ISB6O6IVKHXLQ5TS734TBJUE2KR36F3ZORCPSOROKA5PAW5E7C6Q, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.060605110 (57h59m0.78316815s) [noise=true , address=64.49.13.170:4721 , piece_id=IDQP2IKOKJIDDFQ7LVOIBXNDQM4DBRWTJX5ZLZM5ZCMOVGCZMMRA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.060853125 (57h59m0.783416165s) [noise=true , address=104.36.82.42:4803 , piece_id=46NOG27NWNOO7USQZZLSQKRXSHS6ZZDYFJ4G67PNMZPDCRRHY7KA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.061156415 (57h59m0.783719455s) [noise=true , address=79.127.205.245:4220 , piece_id=YFX3EHNBLM7YFT4TPIXLBIPZDZPMBJPAGDMF6SEDWHFTLZM7X7PA, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.061418717 (57h59m0.783981757s) [noise=true , address=104.36.82.7:4923 , piece_id=B5IYIUUOXFHDQL2YA2QHIHLPJQI66ZSTH6527MMU4UD32JMHN63Q, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:51.061662023 (57h59m0.784225063s) [noise=true , address=104.36.82.55:4194 , piece_id=OTHEUQDH7IEM5J757GAY2M43OIMOYOSWNG2CCFMM3UHGE7GGO3AQ, seg_pos={0 0}, upload=55654]: Uploading piece... Jul 26 21:34:52.159508112 (57h59m1.882071153s) [upload=55654]: Next returned nil segment Jul 26 21:34:52.159525926 (57h59m1.882088966s) [upload=55654]: Waiting for error group managing segments... Jul 26 21:34:52.594017768 (57h59m2.316580808s) [noise=true , address=79.127.205.245:4220 , piece_id=YFX3EHNBLM7YFT4TPIXLBIPZDZPMBJPAGDMF6SEDWHFTLZM7X7PA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:34:52.620314943 (57h59m2.342878013s) [noise=true , address=79.127.205.233:4647 , piece_id=GOKF2BSQ4VBFD7WTL3QED3277S74X2CMWMEU3OMABNHIJ3ZDIX2Q, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:34:52.761899450 (57h59m2.48446248s) [noise=true , address=64.49.13.170:4721 , piece_id=IDQP2IKOKJIDDFQ7LVOIBXNDQM4DBRWTJX5ZLZM5ZCMOVGCZMMRA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:34:53.102602534 (57h59m2.825165574s) [noise=true , address=104.36.82.22:4543 , piece_id=IGJC6PUCA64L5TIRPJV3CV7IL6JBSHSHRQR6HZCL6JKMOLYVXDEA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:02.587595211 (57h59m12.310158251s) [noise=true , address=104.36.82.7:4923 , piece_id=B5IYIUUOXFHDQL2YA2QHIHLPJQI66ZSTH6527MMU4UD32JMHN63Q, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:02.624092011 (57h59m12.346655051s) [noise=true , address=104.36.82.7:4931 , piece_id=2XRG33HE2DQPM5KL3AW62TH6RCG2YJXUZDBO4ZEFKNPJ33TEGUSA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:12.638826116 (57h59m22.361389156s) [noise=true , address=104.36.82.43:4836 , piece_id=3C4X3INXPIU6PA24UENPXCYO6YPBLPO4UPF36KKGERHNQWQY2FWA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:12.820125419 (57h59m22.542688459s) [noise=true , address=104.36.82.5:4860 , piece_id=ISB6O6IVKHXLQ5TS734TBJUE2KR36F3ZORCPSOROKA5PAW5E7C6Q, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:15.936272940 (57h59m25.65883598s) [noise=true , address=104.36.82.42:4803 , piece_id=46NOG27NWNOO7USQZZLSQKRXSHS6ZZDYFJ4G67PNMZPDCRRHY7KA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:16.449041001 (57h59m26.171604031s) [noise=true , address=104.36.82.8:4994 , piece_id=JAHDAXDGSIS7FR64MT7MDSBNLCT4DWL5DC2TATNVPG56JMCDINDA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:19.050564337 (57h59m28.773127377s) [noise=true , address=104.36.82.13:4207 , piece_id=U527R2G4KOSDSHMWEA6ESAOPEURIWWZJKMXCZWFPEPHGTQYIV5DA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:21.262985040 (57h59m30.98554808s) [noise=true , address=104.36.82.50:4034 , piece_id=EI2BZRKUT56RQSQ2SGJUQSL5U7Z5L6YLE3HRCAEDIO26IFVB27DQ, seg_pos={0 0}, upload=55654]: Done uploading piece. err: <nil> Jul 26 21:35:49.947576995 (57h59m59.670140035s) [noise=true , address=104.36.82.54:4191 , piece_id=TXBLNZKAHWKERTGXU6HAD4INJ6N6XZE2SITWBN2L2SG42SC6X6SA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: ecclient: upload failed (node:12d7ChCRcN4pJjJ51aSAPitg3zTRxr5eVbRXVZcvbi6t1gifWmw, address:104.36.82.54:4191): protocol: rpc: dial tcp 104.36.82.54:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:35:49.947623304 (57h59m59.670186344s) [noise=true , address=104.36.82.54:4182 , piece_id=AM4TO7G5NVMEV2VBE5ZQZVPVCVU3PIBLG5WDUMC7LLTKL7MBAIYQ, seg_pos={0 0}, upload=55654]: Done uploading piece. err: ecclient: upload failed (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy, address:104.36.82.54:4182): protocol: rpc: dial tcp 104.36.82.54:4182: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:35:49.947656868 (57h59m59.670219908s) [noise=true , address=104.36.82.47:4518 , piece_id=JEC6O5EN2I453FWWGU43EE4YK5KWCXHVAMGFEMVP42JUDDSYLV3A, seg_pos={0 0}, upload=55654]: Done uploading piece. err: ecclient: upload failed (node:17TZ9JLdCivFF46guhSTW6hcoUmTz5uo5wvLkDqC4BGmpm9eLb, address:104.36.82.47:4518): protocol: rpc: dial tcp 104.36.82.47:4518: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:35:49.947697456 (57h59m59.670260496s) [noise=true , address=104.36.82.53:4153 , piece_id=JSITHZQHE7RIDILNYJHJ7MZ7MUWZ36BBIR3BAELBI4VCFEFQ5RPA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: ecclient: upload failed (node:1fPp4DvLe18dZWPmMPFiC8o9jL4uiEFNmPAHHmFEH74ZXNndw3, address:104.36.82.53:4153): protocol: rpc: dial tcp 104.36.82.53:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:35:49.947726601 (57h59m59.670289641s) [noise=true , address=104.36.82.52:4117 , piece_id=C4ARISN33TG2Z75ZM4P7YT6JGDT4TGQKBS7UD3V5WZ7YMAUWQFTA, seg_pos={0 0}, upload=55654]: Done uploading piece. err: ecclient: upload failed (node:1QVEhFpjfLubGsZmoY1XQdDWevLy2xWdjtPq4JnbSYuBgEXgz7, address:104.36.82.52:4117): protocol: rpc: dial tcp 104.36.82.52:4117: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:35:49.947764433 (57h59m59.670327473s) [noise=true , address=104.36.82.55:4194 , piece_id=OTHEUQDH7IEM5J757GAY2M43OIMOYOSWNG2CCFMM3UHGE7GGO3AQ, seg_pos={0 0}, upload=55654]: Done uploading piece. err: ecclient: upload failed (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh, address:104.36.82.55:4194): protocol: write tcp 188.166.225.170:55268->104.36.82.55:4194: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:35:49.947779423 (57h59m59.670342463s) [seg_pos={0 0}, upload=55654]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 26 21:35:50.177703090 (57h59m59.900266131s) [upload=55654]: Done uploading segments... Jul 26 21:35:50.177721124 (57h59m59.900284164s) [upload=55654]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.231865747s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X....X....] duration: 8.339426369s FAIL (2025-07-26 21:35:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== , address=104.36.82.13:4186 , piece_id=B66ELIOOQMCFCM5FZ5OYTJX5YJRGI3SUICIYOCNDGCP3FZ6R7ONQ, seg_pos={0 0}, upload=55611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:45112->104.36.82.13:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:23.846860758 (57h56m33.569423838s) [seg_pos={0 0}, upload=55611]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:32:23.846960069 (57h56m33.569523109s) [upload=55611]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:32:23.846967833 (57h56m33.569530923s) [upload=55611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:32:24.140008393 (57h56m33.862571433s) [upload=55611]: Done uploading segments... Jul 26 21:32:24.140030354 (57h56m33.862593394s) [upload=55611]: Upload finished. err: <nil> Jul 26 21:32:58.848628916 (57h57m8.571191956s) [upload=55625]: Starting upload Jul 26 21:32:58.848693470 (57h57m8.57125651s) [upload=55625]: Done starting upload Jul 26 21:32:58.848804993 (57h57m8.571368033s) [upload=55625]: Uploading segments... Jul 26 21:32:58.849100608 (57h57m8.571663648s) [upload=55625]: Got next segment. Inline: false Jul 26 21:32:58.849162127 (57h57m8.571725167s) [upload=55625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:32:58.849169350 (57h57m8.57173239s) [upload=55625]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:32:59.081501507 (57h57m8.804064547s) [seg_pos={0 0}, upload=55625]: Begin upload segment... Jul 26 21:32:59.081543577 (57h57m8.804106617s) [seg_pos={0 0}, upload=55625]: Done begin upload segment. Jul 26 21:32:59.081560720 (57h57m8.80412376s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081568745 (57h57m8.804131785s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081608090 (57h57m8.80417113s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081938682 (57h57m8.804501762s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081949754 (57h57m8.804512794s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082209921 (57h57m8.804772961s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082260598 (57h57m8.804823638s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082518673 (57h57m8.805081713s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082773390 (57h57m8.80533642s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083059387 (57h57m8.805622427s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083285820 (57h57m8.80584886s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083495431 (57h57m8.806058471s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083705594 (57h57m8.806268634s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083901268 (57h57m8.806464298s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.085955498 (57h57m8.808518538s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.087265113 (57h57m8.809828154s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:33:00.770004301 (57h57m10.492567331s) [upload=55625]: Next returned nil segment Jul 26 21:33:00.770022166 (57h57m10.492585206s) [upload=55625]: Waiting for error group managing segments... Jul 26 21:33:01.103325942 (57h57m10.825888982s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.103780683 (57h57m10.826343743s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.122250531 (57h57m10.844813581s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.185003338 (57h57m10.907566378s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.192093133 (57h57m10.914656173s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.205502219 (57h57m10.928065259s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.206594729 (57h57m10.929157769s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.252397474 (57h57m10.974960514s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.257171729 (57h57m10.979734769s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.275092778 (57h57m10.997655818s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:04.577165881 (57h57m14.299728921s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:05.192932570 (57h57m14.91549562s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:28.205828302 (57h57m37.928391342s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: rpc: dial tcp 104.36.82.11:4115: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205917181 (57h57m37.928480282s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op Jul 26 21:33:28.205981074 (57h57m37.928544114s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: write tcp 188.166.225.170:43608->104.36.82.6:4874: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205985783 (57h57m37.928548823s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: rpc: dial tcp 104.36.82.2:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205999188 (57h57m37.928562228s) [seg_pos={0 0}, upload=55625]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:33:28.437000046 (57h57m38.159563086s) [upload=55625]: Done uploading segments... Jul 26 21:33:28.437032148 (57h57m38.159595208s) [upload=55625]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 8.339454002s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.........X.................X] duration: 1.653247134s FAIL (2025-07-26 21:35:20 UTC) orbiter warning: digest mismatch: after 0783c6a051cf3b535b7c61f8e6f0cfe751970c7121d9bce2182fd51e29ca8fc6 != before ee59801cb45aa958945ed73fcee20d9c3604e7f558c75f49df119aca36a29d88 Duration: 1.653278324s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X...................................XX..] duration: 12.361309026s FAIL (2025-07-26 21:35:12 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 12.361335055s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X....X...] duration: 10.824114523s FAIL (2025-07-26 21:35:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== , address=104.36.82.13:4186 , piece_id=B66ELIOOQMCFCM5FZ5OYTJX5YJRGI3SUICIYOCNDGCP3FZ6R7ONQ, seg_pos={0 0}, upload=55611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:45112->104.36.82.13:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:23.846860758 (57h56m33.569423838s) [seg_pos={0 0}, upload=55611]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:32:23.846960069 (57h56m33.569523109s) [upload=55611]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:32:23.846967833 (57h56m33.569530923s) [upload=55611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:32:24.140008393 (57h56m33.862571433s) [upload=55611]: Done uploading segments... Jul 26 21:32:24.140030354 (57h56m33.862593394s) [upload=55611]: Upload finished. err: <nil> Jul 26 21:32:58.848628916 (57h57m8.571191956s) [upload=55625]: Starting upload Jul 26 21:32:58.848693470 (57h57m8.57125651s) [upload=55625]: Done starting upload Jul 26 21:32:58.848804993 (57h57m8.571368033s) [upload=55625]: Uploading segments... Jul 26 21:32:58.849100608 (57h57m8.571663648s) [upload=55625]: Got next segment. Inline: false Jul 26 21:32:58.849162127 (57h57m8.571725167s) [upload=55625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:32:58.849169350 (57h57m8.57173239s) [upload=55625]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:32:59.081501507 (57h57m8.804064547s) [seg_pos={0 0}, upload=55625]: Begin upload segment... Jul 26 21:32:59.081543577 (57h57m8.804106617s) [seg_pos={0 0}, upload=55625]: Done begin upload segment. Jul 26 21:32:59.081560720 (57h57m8.80412376s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081568745 (57h57m8.804131785s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081608090 (57h57m8.80417113s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081938682 (57h57m8.804501762s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081949754 (57h57m8.804512794s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082209921 (57h57m8.804772961s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082260598 (57h57m8.804823638s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082518673 (57h57m8.805081713s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082773390 (57h57m8.80533642s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083059387 (57h57m8.805622427s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083285820 (57h57m8.80584886s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083495431 (57h57m8.806058471s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083705594 (57h57m8.806268634s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083901268 (57h57m8.806464298s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.085955498 (57h57m8.808518538s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.087265113 (57h57m8.809828154s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:33:00.770004301 (57h57m10.492567331s) [upload=55625]: Next returned nil segment Jul 26 21:33:00.770022166 (57h57m10.492585206s) [upload=55625]: Waiting for error group managing segments... Jul 26 21:33:01.103325942 (57h57m10.825888982s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.103780683 (57h57m10.826343743s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.122250531 (57h57m10.844813581s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.185003338 (57h57m10.907566378s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.192093133 (57h57m10.914656173s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.205502219 (57h57m10.928065259s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.206594729 (57h57m10.929157769s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.252397474 (57h57m10.974960514s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.257171729 (57h57m10.979734769s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.275092778 (57h57m10.997655818s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:04.577165881 (57h57m14.299728921s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:05.192932570 (57h57m14.91549562s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:28.205828302 (57h57m37.928391342s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: rpc: dial tcp 104.36.82.11:4115: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205917181 (57h57m37.928480282s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op Jul 26 21:33:28.205981074 (57h57m37.928544114s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: write tcp 188.166.225.170:43608->104.36.82.6:4874: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205985783 (57h57m37.928548823s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: rpc: dial tcp 104.36.82.2:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205999188 (57h57m37.928562228s) [seg_pos={0 0}, upload=55625]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:33:28.437000046 (57h57m38.159563086s) [upload=55625]: Done uploading segments... Jul 26 21:33:28.437032148 (57h57m38.159595208s) [upload=55625]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 10.824142868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 1m0.233402221s FAIL (2025-07-26 21:34:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== eg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.795019865 (57h57m53.517582905s) [noise=true , address=79.127.205.246:4279 , piece_id=N66CVDXFAZRL2JS4BOZZWKEUIXKCBTCLKFX4TD4HJUWAOYBCOD5A, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.795293749 (57h57m53.517856789s) [noise=true , address=104.36.82.20:4440 , piece_id=TGFBCPQHGUOLSLZ6NPX27RXX4ICLLIRQUCDXEUEZIIEMZDSJ7P2Q, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.795540020 (57h57m53.51810306s) [noise=true , address=79.127.205.245:4227 , piece_id=2E7WJ6G3ABG7HFN6CM6NEMHKQXV6AEATTFEG2K3TLQOUV4VEH3UA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.795602259 (57h57m53.518165339s) [noise=true , address=104.36.82.53:4139 , piece_id=BFXZ4DA6LT5YHTDRFDZUBXNJ44WZKYZBBKEQIDGMB7DAPSUEM6YA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.795787444 (57h57m53.518350484s) [noise=true , address=64.49.13.140:4514 , piece_id=RIYBZWYEV7AP65OXVQHJQNR3NWTA2GXFWCCD7C3MOTHJZ6LDUEAA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796030629 (57h57m53.518593669s) [noise=true , address=104.36.82.56:4258 , piece_id=JUDTN66VDLLBWQVOSSC5OHXAAMPUJG6U5ILUTIGPSQ7CVC7MIW5A, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796116954 (57h57m53.518679994s) [noise=true , address=77.90.31.17:4774 , piece_id=L5FOGPIGHI4YYRWHAEG54KUVPVCBXJI7UWB6WQUPFKUFP2Q2VSLQ, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796293521 (57h57m53.518856562s) [noise=true , address=104.36.82.54:4176 , piece_id=444SRJYF2DX2IYWIFOQBZD74MVZ5ZN5Z35BWV3KJAZSAVQ65BIXA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796474849 (57h57m53.519037889s) [noise=true , address=104.36.82.46:4499 , piece_id=73AB6ODF4VKVFBBFOD56KCXXDVW6WH77KVCQJXJTIQDBMG5E42HA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796515867 (57h57m53.519078907s) [noise=true , address=104.36.82.55:4198 , piece_id=VO7NW3XQ2QSCZ2GLLEAXQ2MMNGTMXXJSWL2BNV7MDZJWCS3SY34A, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796726360 (57h57m53.51928939s) [noise=true , address=104.36.82.47:4531 , piece_id=AOEQB3WUJA34NBFXBJK6ZC73O2JJ54OMILTU2YSZ6DONV3YJJCLQ, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796755235 (57h57m53.519318265s) [noise=true , address=104.36.82.12:4161 , piece_id=RQWYOT6G3VNJEJNMFCAYIPWDK6WUDR4FAEHIJNX5HVBPEC4SEHRA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.796946291 (57h57m53.519509331s) [noise=true , address=79.127.201.215:4354 , piece_id=H4EEZLT43VM7YQ5ZUEUUM5JF6WAGV22SFWOCEVPJWBTONIQSJXCA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.797170149 (57h57m53.519733179s) [noise=true , address=104.36.82.51:4067 , piece_id=NCNCERDE4MD2ELMPEQF6ZPUV3E4VEWXXB3KCDH6LLVFUQPKPHDYQ, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.797364110 (57h57m53.51992715s) [noise=true , address=77.90.31.13:4644 , piece_id=OIF2WYFAHOW2YRRAF7L3NAYXWGH7OTX3AMY2LK42UAUXKDDJX6FA, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.797557059 (57h57m53.520120099s) [noise=true , address=79.127.205.235:4666 , piece_id=E3DBFFL2V5JX554BRYSKD2QJSJJ6JRTGD7ZW4CYV4WXV3AFHNVMQ, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:43.798378351 (57h57m53.520941391s) [noise=true , address=104.36.82.3:4799 , piece_id=Z5TRMRLI44LBQNRFRYB2GTMY5KFJ3JHWV5NFZ2ARJIE4ESPMLX5A, seg_pos={0 0}, upload=55635]: Uploading piece... Jul 26 21:33:44.891574555 (57h57m54.614137595s) [upload=55635]: Next returned nil segment Jul 26 21:33:44.891611757 (57h57m54.614174797s) [upload=55635]: Waiting for error group managing segments... Jul 26 21:33:45.177901310 (57h57m54.90046435s) [noise=true , address=79.127.205.235:4666 , piece_id=E3DBFFL2V5JX554BRYSKD2QJSJJ6JRTGD7ZW4CYV4WXV3AFHNVMQ, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:33:45.210257318 (57h57m54.932820358s) [noise=true , address=79.127.205.246:4279 , piece_id=N66CVDXFAZRL2JS4BOZZWKEUIXKCBTCLKFX4TD4HJUWAOYBCOD5A, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:33:45.444414285 (57h57m55.166977375s) [noise=true , address=79.127.205.245:4227 , piece_id=2E7WJ6G3ABG7HFN6CM6NEMHKQXV6AEATTFEG2K3TLQOUV4VEH3UA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:33:45.903941069 (57h57m55.626504109s) [noise=true , address=104.36.82.16:4325 , piece_id=KOZXZM37VKS2L7JDW3YE5JYUAT3RWRYOMZNHJI3LUAKY5RGI4UNA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:33:46.120547717 (57h57m55.843110747s) [noise=true , address=64.49.13.140:4514 , piece_id=RIYBZWYEV7AP65OXVQHJQNR3NWTA2GXFWCCD7C3MOTHJZ6LDUEAA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:33:47.013084504 (57h57m56.735647534s) [noise=true , address=79.127.201.215:4354 , piece_id=H4EEZLT43VM7YQ5ZUEUUM5JF6WAGV22SFWOCEVPJWBTONIQSJXCA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:33:47.899039880 (57h57m57.62160292s) [noise=true , address=77.90.31.17:4774 , piece_id=L5FOGPIGHI4YYRWHAEG54KUVPVCBXJI7UWB6WQUPFKUFP2Q2VSLQ, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:33:47.985693556 (57h57m57.708256596s) [noise=true , address=77.90.31.13:4644 , piece_id=OIF2WYFAHOW2YRRAF7L3NAYXWGH7OTX3AMY2LK42UAUXKDDJX6FA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:34:21.614936612 (57h58m31.337499652s) [noise=true , address=104.36.82.51:4067 , piece_id=NCNCERDE4MD2ELMPEQF6ZPUV3E4VEWXXB3KCDH6LLVFUQPKPHDYQ, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:34:28.865644037 (57h58m38.588207067s) [noise=true , address=104.36.82.3:4799 , piece_id=Z5TRMRLI44LBQNRFRYB2GTMY5KFJ3JHWV5NFZ2ARJIE4ESPMLX5A, seg_pos={0 0}, upload=55635]: Done uploading piece. err: <nil> Jul 26 21:34:42.709374324 (57h58m52.431937374s) [noise=true , address=104.36.82.56:4258 , piece_id=JUDTN66VDLLBWQVOSSC5OHXAAMPUJG6U5ILUTIGPSQ7CVC7MIW5A, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:12g7DdMjQHyYTD9hRvixfNedxyPr6q6uE2rLdEbhQ1MGANRMDm3, address:104.36.82.56:4258): protocol: rpc: dial tcp 104.36.82.56:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709427716 (57h58m52.431990756s) [noise=true , address=104.36.82.54:4176 , piece_id=444SRJYF2DX2IYWIFOQBZD74MVZ5ZN5Z35BWV3KJAZSAVQ65BIXA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD, address:104.36.82.54:4176): protocol: rpc: dial tcp 104.36.82.54:4176: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709469356 (57h58m52.432032396s) [noise=true , address=104.36.82.55:4198 , piece_id=VO7NW3XQ2QSCZ2GLLEAXQ2MMNGTMXXJSWL2BNV7MDZJWCS3SY34A, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:104.36.82.55:4198): protocol: write tcp 188.166.225.170:56108->104.36.82.55:4198: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709499734 (57h58m52.432062784s) [noise=true , address=104.36.82.20:4440 , piece_id=TGFBCPQHGUOLSLZ6NPX27RXX4ICLLIRQUCDXEUEZIIEMZDSJ7P2Q, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:12GfuKp6kJEy1NTHpo9i21UDm62hrAtKq7124Z6FUehNyyLQ33i, address:104.36.82.20:4440): protocol: rpc: dial tcp 104.36.82.20:4440: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709558066 (57h58m52.432121106s) [noise=true , address=104.36.82.53:4139 , piece_id=BFXZ4DA6LT5YHTDRFDZUBXNJ44WZKYZBBKEQIDGMB7DAPSUEM6YA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:12T99BLYzWYXV5VkEKAYQVyzoeHA4XYz4Jrh8Dz3K6jqkec52Lg, address:104.36.82.53:4139): protocol: write tcp 188.166.225.170:50470->104.36.82.53:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709593874 (57h58m52.432156904s) [noise=true , address=104.36.82.46:4499 , piece_id=73AB6ODF4VKVFBBFOD56KCXXDVW6WH77KVCQJXJTIQDBMG5E42HA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:1JR5bVTizvQCY5utaGUDgLHvCJfrbbpixmKNrq5vjiRB8VaSoc, address:104.36.82.46:4499): protocol: write tcp 188.166.225.170:37780->104.36.82.46:4499: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709628380 (57h58m52.43219142s) [noise=true , address=104.36.82.47:4531 , piece_id=AOEQB3WUJA34NBFXBJK6ZC73O2JJ54OMILTU2YSZ6DONV3YJJCLQ, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:12LZprfyqfD2YUwgAarzyjbgHEb6jMhAMAday5C45xk3j9RUS4u, address:104.36.82.47:4531): protocol: rpc: dial tcp 104.36.82.47:4531: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709635794 (57h58m52.432198835s) [noise=true , address=104.36.82.12:4161 , piece_id=RQWYOT6G3VNJEJNMFCAYIPWDK6WUDR4FAEHIJNX5HVBPEC4SEHRA, seg_pos={0 0}, upload=55635]: Done uploading piece. err: ecclient: upload failed (node:1SdSwg6tZCKSturNytQmWUmSWQ2G5dUSrb2RA8hxLLpBtBE6tf, address:104.36.82.12:4161): protocol: write tcp 188.166.225.170:37560->104.36.82.12:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:34:42.709667535 (57h58m52.432230575s) [seg_pos={0 0}, upload=55635]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 26 21:34:42.941179192 (57h58m52.663742222s) [upload=55635]: Done uploading segments... Jul 26 21:34:42.941204590 (57h58m52.66376762s) [upload=55635]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.233414926s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X.........X.................] duration: 1.856701093s FAIL (2025-07-26 21:34:38 UTC) orbiter warning: uplink: too many requests Duration: 1.856729007s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X....X..] duration: 7.59125504s FAIL (2025-07-26 21:34:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== , address=104.36.82.13:4186 , piece_id=B66ELIOOQMCFCM5FZ5OYTJX5YJRGI3SUICIYOCNDGCP3FZ6R7ONQ, seg_pos={0 0}, upload=55611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:45112->104.36.82.13:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:23.846860758 (57h56m33.569423838s) [seg_pos={0 0}, upload=55611]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:32:23.846960069 (57h56m33.569523109s) [upload=55611]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:32:23.846967833 (57h56m33.569530923s) [upload=55611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:32:24.140008393 (57h56m33.862571433s) [upload=55611]: Done uploading segments... Jul 26 21:32:24.140030354 (57h56m33.862593394s) [upload=55611]: Upload finished. err: <nil> Jul 26 21:32:58.848628916 (57h57m8.571191956s) [upload=55625]: Starting upload Jul 26 21:32:58.848693470 (57h57m8.57125651s) [upload=55625]: Done starting upload Jul 26 21:32:58.848804993 (57h57m8.571368033s) [upload=55625]: Uploading segments... Jul 26 21:32:58.849100608 (57h57m8.571663648s) [upload=55625]: Got next segment. Inline: false Jul 26 21:32:58.849162127 (57h57m8.571725167s) [upload=55625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:32:58.849169350 (57h57m8.57173239s) [upload=55625]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:32:59.081501507 (57h57m8.804064547s) [seg_pos={0 0}, upload=55625]: Begin upload segment... Jul 26 21:32:59.081543577 (57h57m8.804106617s) [seg_pos={0 0}, upload=55625]: Done begin upload segment. Jul 26 21:32:59.081560720 (57h57m8.80412376s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081568745 (57h57m8.804131785s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081608090 (57h57m8.80417113s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081938682 (57h57m8.804501762s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081949754 (57h57m8.804512794s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082209921 (57h57m8.804772961s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082260598 (57h57m8.804823638s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082518673 (57h57m8.805081713s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082773390 (57h57m8.80533642s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083059387 (57h57m8.805622427s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083285820 (57h57m8.80584886s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083495431 (57h57m8.806058471s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083705594 (57h57m8.806268634s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083901268 (57h57m8.806464298s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.085955498 (57h57m8.808518538s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.087265113 (57h57m8.809828154s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:33:00.770004301 (57h57m10.492567331s) [upload=55625]: Next returned nil segment Jul 26 21:33:00.770022166 (57h57m10.492585206s) [upload=55625]: Waiting for error group managing segments... Jul 26 21:33:01.103325942 (57h57m10.825888982s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.103780683 (57h57m10.826343743s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.122250531 (57h57m10.844813581s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.185003338 (57h57m10.907566378s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.192093133 (57h57m10.914656173s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.205502219 (57h57m10.928065259s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.206594729 (57h57m10.929157769s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.252397474 (57h57m10.974960514s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.257171729 (57h57m10.979734769s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.275092778 (57h57m10.997655818s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:04.577165881 (57h57m14.299728921s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:05.192932570 (57h57m14.91549562s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:28.205828302 (57h57m37.928391342s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: rpc: dial tcp 104.36.82.11:4115: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205917181 (57h57m37.928480282s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op Jul 26 21:33:28.205981074 (57h57m37.928544114s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: write tcp 188.166.225.170:43608->104.36.82.6:4874: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205985783 (57h57m37.928548823s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: rpc: dial tcp 104.36.82.2:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205999188 (57h57m37.928562228s) [seg_pos={0 0}, upload=55625]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:33:28.437000046 (57h57m38.159563086s) [upload=55625]: Done uploading segments... Jul 26 21:33:28.437032148 (57h57m38.159595208s) [upload=55625]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 7.59131245s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...................................XX.] duration: 10.488931727s FAIL (2025-07-26 21:34:12 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 10.488950021s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.....................X...................................XX] duration: 30.241749447s FAIL (2025-07-26 21:34:02 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.241772202s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.........X................] duration: 1.875077633s FAIL (2025-07-26 21:33:53 UTC) orbiter warning: uplink: too many requests Duration: 1.875110085s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 1m0.232572859s FAIL (2025-07-26 21:33:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 9) ======LOGS====== load=55618]: Uploading piece... Jul 26 21:32:43.338615403 (57h56m53.061178443s) [noise=true , address=104.36.82.38:4722 , piece_id=N72D4CF475YEMNDWFAJS5YAPD5SWGEWF4CEAEKHDWXHEE3RGNZTQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.339132072 (57h56m53.061695132s) [noise=true , address=104.36.82.46:4490 , piece_id=3PEEMNTLGH2FO6TOC77QORPXXW35O2WBX444LFSEVXYLIYL53OZA, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.339557255 (57h56m53.062120315s) [noise=true , address=79.127.205.245:4238 , piece_id=OFUAAII5MMJNRGBMTN7ZHHG5VVBIAZGBG54AJNRGDRFBOAWJMBGA, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.339936431 (57h56m53.062499461s) [noise=true , address=79.127.201.215:4349 , piece_id=EQNA3VQD6SFEDACKDXHTISEFAQNFB22K2YULE4ML6FJB2WKEEXYQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.340320746 (57h56m53.062883796s) [noise=true , address=104.36.82.9:4014 , piece_id=2HVTEVHW2RF3CODDKONIQMIVLAELZ4NWLJNQYOYOSDXVCPYT7UBQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.340654294 (57h56m53.063217334s) [noise=true , address=104.36.82.47:4521 , piece_id=XM5MWKKEC7GFNDMGL4ENM2XCZA7UMCECG2PGDCTLZSXAT5MGJIXQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.340984766 (57h56m53.063547806s) [noise=true , address=104.36.82.54:4171 , piece_id=QNJDF6T6HCM3RNVLN7AASCTUYKIDLGKHJPOCVDQDY4YR5JKVOXLQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.341390523 (57h56m53.063953563s) [noise=true , address=77.90.31.18:4831 , piece_id=3R64HTKKN5OIL4VJ4CZMNFJQ26UTTVOZYRE7NZTPOYDICNLQF2BQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.341767264 (57h56m53.064330304s) [noise=true , address=104.36.82.52:4098 , piece_id=RBY6I6FR6XWNUNUNOFKOPBKMJQFNLRXWQAKX2BAVK25YRXCNFJNQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.342101153 (57h56m53.064664193s) [noise=true , address=77.90.31.13:4658 , piece_id=FPNACYUDUCHZ5GXMJWLYY6ZNGVILA5HIECWBGGLCQFWTXCVVK64Q, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.342395486 (57h56m53.064958526s) [noise=true , address=64.49.13.155:4923 , piece_id=CRVRM7U27IVA4XNIT4WNVLTWBDV336B3LEWUY236T3QE5GYCSGPA, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.342725047 (57h56m53.065288087s) [noise=true , address=79.127.205.235:4678 , piece_id=JRTZ6OBPIGRSFGKXWYWHPUKPWMJ3YKDJB3V23R26JL5VMGJFDOPA, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.343039919 (57h56m53.065602959s) [noise=true , address=79.127.219.38:4018 , piece_id=GDONHRAVZDMUBGDWTSH6CFQEDFT5CP7YZSD3TRMZSIXEFGFLIFMA, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.343342918 (57h56m53.065905968s) [noise=true , address=104.36.82.53:4122 , piece_id=3Z63ATSWNFD5N7OF42NKJMR4TSULHKDZIGN4GZOHRY6QFUADSSEQ, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:43.343643844 (57h56m53.066206884s) [noise=true , address=77.90.31.21:4897 , piece_id=AMPEQSS3NLWG5FCWMYFUHABG2YG6CORGFAAFFEJXB3MTJYAPS7KA, seg_pos={0 0}, upload=55618]: Uploading piece... Jul 26 21:32:44.435847500 (57h56m54.15841054s) [upload=55618]: Next returned nil segment Jul 26 21:32:44.435867930 (57h56m54.15843096s) [upload=55618]: Waiting for error group managing segments... Jul 26 21:32:44.733161578 (57h56m54.455724618s) [noise=true , address=79.127.205.245:4238 , piece_id=OFUAAII5MMJNRGBMTN7ZHHG5VVBIAZGBG54AJNRGDRFBOAWJMBGA, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:44.809863453 (57h56m54.532426493s) [noise=true , address=79.127.205.235:4678 , piece_id=JRTZ6OBPIGRSFGKXWYWHPUKPWMJ3YKDJB3V23R26JL5VMGJFDOPA, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:44.810001767 (57h56m54.532564807s) [noise=true , address=64.49.13.155:4923 , piece_id=CRVRM7U27IVA4XNIT4WNVLTWBDV336B3LEWUY236T3QE5GYCSGPA, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:45.222912748 (57h56m54.945475778s) [noise=true , address=45.91.116.10:4100 , piece_id=ZOK2ZRQN5ONQD7VGWERSXUXUFWUG2IBO2YDNSPEYGHUGZJ54IWKA, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:45.305709455 (57h56m55.028272525s) [noise=true , address=79.127.219.38:4018 , piece_id=GDONHRAVZDMUBGDWTSH6CFQEDFT5CP7YZSD3TRMZSIXEFGFLIFMA, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:45.694739895 (57h56m55.417302935s) [noise=true , address=79.127.201.215:4349 , piece_id=EQNA3VQD6SFEDACKDXHTISEFAQNFB22K2YULE4ML6FJB2WKEEXYQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:48.232458244 (57h56m57.955021284s) [noise=true , address=77.90.31.21:4897 , piece_id=AMPEQSS3NLWG5FCWMYFUHABG2YG6CORGFAAFFEJXB3MTJYAPS7KA, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:48.529619037 (57h56m58.252182067s) [noise=true , address=77.90.31.13:4658 , piece_id=FPNACYUDUCHZ5GXMJWLYY6ZNGVILA5HIECWBGGLCQFWTXCVVK64Q, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:32:49.283263151 (57h56m59.005826191s) [noise=true , address=77.90.31.18:4831 , piece_id=3R64HTKKN5OIL4VJ4CZMNFJQ26UTTVOZYRE7NZTPOYDICNLQF2BQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: <nil> Jul 26 21:33:42.244828443 (57h57m51.967391483s) [noise=true , address=104.36.82.47:4521 , piece_id=XM5MWKKEC7GFNDMGL4ENM2XCZA7UMCECG2PGDCTLZSXAT5MGJIXQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:12GQHySYUuqERoQyP4fCib2nRMNJhgpP2NkDzVxz6nurLkeJ5VD, address:104.36.82.47:4521): protocol: write tcp 188.166.225.170:54844->104.36.82.47:4521: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.244877646 (57h57m51.967440677s) [noise=true , address=104.36.82.21:4478 , piece_id=UYYZWG6XU5OXSGJAMYX6YN2LCKCJ5NNOP7ISDCDB7ROGYRZ5H5VQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:17kFjjJyvHApPUxUHJ6HeMEBCoo6xTbr8QizXjBEHwWj3mZUha, address:104.36.82.21:4478): protocol: write tcp 188.166.225.170:45706->104.36.82.21:4478: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.244908206 (57h57m51.967471246s) [noise=true , address=104.36.82.55:4210 , piece_id=4BK53GIYE5EYB7AK67GDXTCTTOMHLKQRAC6D2HH6KW22EDNK2PRQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:12KuoSWvJCc3mfowPPSJkdCDewkrHZnG6gz1fWcmJRGR5wvHzLL, address:104.36.82.55:4210): protocol: write tcp 188.166.225.170:33192->104.36.82.55:4210: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.245023126 (57h57m51.967586166s) [noise=true , address=104.36.82.53:4122 , piece_id=3Z63ATSWNFD5N7OF42NKJMR4TSULHKDZIGN4GZOHRY6QFUADSSEQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:124d52DhtbtwipVpZuWdpFTQAttR18hy1K1BbokNRX4R1bLtzTi, address:104.36.82.53:4122): protocol: write tcp 188.166.225.170:41042->104.36.82.53:4122: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.245066037 (57h57m51.967629077s) [noise=true , address=104.36.82.52:4098 , piece_id=RBY6I6FR6XWNUNUNOFKOPBKMJQFNLRXWQAKX2BAVK25YRXCNFJNQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:1SoFNdwfh4p5tXUkpfjQaev6tdA2ZdhsXUFvZNBsy5QrJ9zdqb, address:104.36.82.52:4098): protocol: write tcp 188.166.225.170:44574->104.36.82.52:4098: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.245089682 (57h57m51.967652723s) [noise=true , address=104.36.82.46:4490 , piece_id=3PEEMNTLGH2FO6TOC77QORPXXW35O2WBX444LFSEVXYLIYL53OZA, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji, address:104.36.82.46:4490): protocol: write tcp 188.166.225.170:56976->104.36.82.46:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.245142844 (57h57m51.967705874s) [noise=true , address=104.36.82.38:4722 , piece_id=N72D4CF475YEMNDWFAJS5YAPD5SWGEWF4CEAEKHDWXHEE3RGNZTQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:12Zw3dtUg9gARz52KhwDLTjcqC3CNm7dpPzpdx7P7PbL1jwe8uc, address:104.36.82.38:4722): protocol: write tcp 188.166.225.170:39174->104.36.82.38:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.245153244 (57h57m51.967716284s) [noise=true , address=104.36.82.54:4171 , piece_id=QNJDF6T6HCM3RNVLN7AASCTUYKIDLGKHJPOCVDQDY4YR5JKVOXLQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3, address:104.36.82.54:4171): protocol: write tcp 188.166.225.170:35668->104.36.82.54:4171: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.245157883 (57h57m51.967720944s) [noise=true , address=104.36.82.9:4014 , piece_id=2HVTEVHW2RF3CODDKONIQMIVLAELZ4NWLJNQYOYOSDXVCPYT7UBQ, seg_pos={0 0}, upload=55618]: Done uploading piece. err: ecclient: upload failed (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy, address:104.36.82.9:4014): protocol: write tcp 188.166.225.170:60916->104.36.82.9:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:42.245176989 (57h57m51.967740029s) [seg_pos={0 0}, upload=55618]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil> Jul 26 21:33:42.475923591 (57h57m52.198486621s) [upload=55618]: Done uploading segments... Jul 26 21:33:42.475951805 (57h57m52.198514835s) [upload=55618]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9) Duration: 1m0.232584441s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X....X.] duration: 9.613470375s FAIL (2025-07-26 21:33:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== , address=104.36.82.13:4186 , piece_id=B66ELIOOQMCFCM5FZ5OYTJX5YJRGI3SUICIYOCNDGCP3FZ6R7ONQ, seg_pos={0 0}, upload=55611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:45112->104.36.82.13:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:23.846860758 (57h56m33.569423838s) [seg_pos={0 0}, upload=55611]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:32:23.846960069 (57h56m33.569523109s) [upload=55611]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:32:23.846967833 (57h56m33.569530923s) [upload=55611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:32:24.140008393 (57h56m33.862571433s) [upload=55611]: Done uploading segments... Jul 26 21:32:24.140030354 (57h56m33.862593394s) [upload=55611]: Upload finished. err: <nil> Jul 26 21:32:58.848628916 (57h57m8.571191956s) [upload=55625]: Starting upload Jul 26 21:32:58.848693470 (57h57m8.57125651s) [upload=55625]: Done starting upload Jul 26 21:32:58.848804993 (57h57m8.571368033s) [upload=55625]: Uploading segments... Jul 26 21:32:58.849100608 (57h57m8.571663648s) [upload=55625]: Got next segment. Inline: false Jul 26 21:32:58.849162127 (57h57m8.571725167s) [upload=55625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:32:58.849169350 (57h57m8.57173239s) [upload=55625]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:32:59.081501507 (57h57m8.804064547s) [seg_pos={0 0}, upload=55625]: Begin upload segment... Jul 26 21:32:59.081543577 (57h57m8.804106617s) [seg_pos={0 0}, upload=55625]: Done begin upload segment. Jul 26 21:32:59.081560720 (57h57m8.80412376s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081568745 (57h57m8.804131785s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081608090 (57h57m8.80417113s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081938682 (57h57m8.804501762s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081949754 (57h57m8.804512794s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082209921 (57h57m8.804772961s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082260598 (57h57m8.804823638s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082518673 (57h57m8.805081713s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082773390 (57h57m8.80533642s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083059387 (57h57m8.805622427s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083285820 (57h57m8.80584886s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083495431 (57h57m8.806058471s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083705594 (57h57m8.806268634s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083901268 (57h57m8.806464298s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.085955498 (57h57m8.808518538s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.087265113 (57h57m8.809828154s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:33:00.770004301 (57h57m10.492567331s) [upload=55625]: Next returned nil segment Jul 26 21:33:00.770022166 (57h57m10.492585206s) [upload=55625]: Waiting for error group managing segments... Jul 26 21:33:01.103325942 (57h57m10.825888982s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.103780683 (57h57m10.826343743s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.122250531 (57h57m10.844813581s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.185003338 (57h57m10.907566378s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.192093133 (57h57m10.914656173s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.205502219 (57h57m10.928065259s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.206594729 (57h57m10.929157769s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.252397474 (57h57m10.974960514s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.257171729 (57h57m10.979734769s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.275092778 (57h57m10.997655818s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:04.577165881 (57h57m14.299728921s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:05.192932570 (57h57m14.91549562s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:28.205828302 (57h57m37.928391342s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: rpc: dial tcp 104.36.82.11:4115: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205917181 (57h57m37.928480282s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op Jul 26 21:33:28.205981074 (57h57m37.928544114s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: write tcp 188.166.225.170:43608->104.36.82.6:4874: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205985783 (57h57m37.928548823s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: rpc: dial tcp 104.36.82.2:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205999188 (57h57m37.928562228s) [seg_pos={0 0}, upload=55625]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:33:28.437000046 (57h57m38.159563086s) [upload=55625]: Done uploading segments... Jul 26 21:33:28.437032148 (57h57m38.159595208s) [upload=55625]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 9.613486917s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X....X] duration: 30.232925847s FAIL (2025-07-26 21:33:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== , address=104.36.82.13:4186 , piece_id=B66ELIOOQMCFCM5FZ5OYTJX5YJRGI3SUICIYOCNDGCP3FZ6R7ONQ, seg_pos={0 0}, upload=55611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:45112->104.36.82.13:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:23.846860758 (57h56m33.569423838s) [seg_pos={0 0}, upload=55611]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:32:23.846960069 (57h56m33.569523109s) [upload=55611]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:32:23.846967833 (57h56m33.569530923s) [upload=55611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:32:24.140008393 (57h56m33.862571433s) [upload=55611]: Done uploading segments... Jul 26 21:32:24.140030354 (57h56m33.862593394s) [upload=55611]: Upload finished. err: <nil> Jul 26 21:32:58.848628916 (57h57m8.571191956s) [upload=55625]: Starting upload Jul 26 21:32:58.848693470 (57h57m8.57125651s) [upload=55625]: Done starting upload Jul 26 21:32:58.848804993 (57h57m8.571368033s) [upload=55625]: Uploading segments... Jul 26 21:32:58.849100608 (57h57m8.571663648s) [upload=55625]: Got next segment. Inline: false Jul 26 21:32:58.849162127 (57h57m8.571725167s) [upload=55625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:32:58.849169350 (57h57m8.57173239s) [upload=55625]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:32:59.081501507 (57h57m8.804064547s) [seg_pos={0 0}, upload=55625]: Begin upload segment... Jul 26 21:32:59.081543577 (57h57m8.804106617s) [seg_pos={0 0}, upload=55625]: Done begin upload segment. Jul 26 21:32:59.081560720 (57h57m8.80412376s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081568745 (57h57m8.804131785s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081608090 (57h57m8.80417113s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081938682 (57h57m8.804501762s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.081949754 (57h57m8.804512794s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082209921 (57h57m8.804772961s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082260598 (57h57m8.804823638s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082518673 (57h57m8.805081713s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.082773390 (57h57m8.80533642s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083059387 (57h57m8.805622427s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083285820 (57h57m8.80584886s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083495431 (57h57m8.806058471s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083705594 (57h57m8.806268634s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.083901268 (57h57m8.806464298s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.085955498 (57h57m8.808518538s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:32:59.087265113 (57h57m8.809828154s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Uploading piece... Jul 26 21:33:00.770004301 (57h57m10.492567331s) [upload=55625]: Next returned nil segment Jul 26 21:33:00.770022166 (57h57m10.492585206s) [upload=55625]: Waiting for error group managing segments... Jul 26 21:33:01.103325942 (57h57m10.825888982s) [noise=true , address=45.91.116.5:4298 , piece_id=7CGF6VDLSHLZH4LME6SNU3G55HVCW4H7RT2EE5C77MNTGWKBFG5A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.103780683 (57h57m10.826343743s) [noise=true , address=45.91.116.5:4299 , piece_id=Q25W2W25GM7BOCIE5JWXXX3EN6QG6QCADRJ3NBMMA2GY6ERSQH7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.122250531 (57h57m10.844813581s) [noise=true , address=45.91.116.7:4011 , piece_id=ATQ6DW4LQ3UUK6RHOX6RZ7N3TAAD33NDL4SAU6H36WERV4KOG54A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.185003338 (57h57m10.907566378s) [noise=true , address=45.91.116.13:4154 , piece_id=2XAOLRQV457NXAPEJPYLFLHOSLUYREP2ZFPO73QZHLLNDRWRXW7Q, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.192093133 (57h57m10.914656173s) [noise=true , address=45.91.116.9:4261 , piece_id=LIKCH6ZJNMIB5RWJENQMHLOM6MXKAABG4M556JRG2Y4HOOOV5JYA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.205502219 (57h57m10.928065259s) [noise=true , address=45.91.116.12:4226 , piece_id=WYYIGJZBOPCG6KDROLZXHYOWKUBQVLDMN554V32QI7AWCE7JPKMQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.206594729 (57h57m10.929157769s) [noise=true , address=45.91.116.11:4118 , piece_id=HMBWSCR4FHW5RFCMJ3KY7SX3TXT52B7BKNCOP2IQ3D5FNIJSJRYQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.252397474 (57h57m10.974960514s) [noise=true , address=45.91.116.10:4082 , piece_id=2E4Y7CEJEY4D7FWGFTP2YTFIH2Q2GE3YNBQUXILN44ZOEIDUDRPQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.257171729 (57h57m10.979734769s) [noise=true , address=45.91.116.7:4009 , piece_id=E6LLVKKKLBNTC4P75MP747B4TII7VAFYDCYU5UDWPEEUTVUZDN3A, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:01.275092778 (57h57m10.997655818s) [noise=true , address=45.91.116.6:4975 , piece_id=3QW3RWSSZHRYPP7SSVE7CJN57GVFCFQIRNM3SUS2IPEMNEWTBNCQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:04.577165881 (57h57m14.299728921s) [noise=true , address=77.90.31.17:4772 , piece_id=GQFJ672UHU3N4EV322G5K57RRNBTEK6YZ7JEAPAPC4K3JUEQTDFA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:05.192932570 (57h57m14.91549562s) [noise=true , address=77.90.31.18:4807 , piece_id=EZRQAN27S4MPXSSTL4UC6MGT5UZXA4D3RAQPAF34RZ3WB7EM3TTA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: <nil> Jul 26 21:33:28.205828302 (57h57m37.928391342s) [noise=true , address=104.36.82.11:4115 , piece_id=TBMHH56ITXQ7QM3L36B4KMOTKJSGM2JHXURCPLDVERYHT2WS4MRQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: rpc: dial tcp 104.36.82.11:4115: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205917181 (57h57m37.928480282s) [noise=true , address=104.36.82.11:4114 , piece_id=CBI3XXQ4SDZIIRYEM4E7PHF3PQIKANOXPOYUYIKTRJRIK5WZZ5YQ, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op Jul 26 21:33:28.205981074 (57h57m37.928544114s) [noise=true , address=104.36.82.6:4874 , piece_id=FBO2BWW5XLUYQLL6F4MNKTARGSQFIPLLE2N6O6M3LQLRIT3XYEWA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: write tcp 188.166.225.170:43608->104.36.82.6:4874: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205985783 (57h57m37.928548823s) [noise=true , address=104.36.82.2:4730 , piece_id=X76NV6YWUHUGKF2E6VMW353J2H3SI2O7E7XIM2V3SY6FHR5QYIIA, seg_pos={0 0}, upload=55625]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: rpc: dial tcp 104.36.82.2:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:33:28.205999188 (57h57m37.928562228s) [seg_pos={0 0}, upload=55625]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:33:28.437000046 (57h57m38.159563086s) [upload=55625]: Done uploading segments... Jul 26 21:33:28.437032148 (57h57m38.159595208s) [upload=55625]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.232952189s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.....................X...................................X] duration: 30.232553631s FAIL (2025-07-26 21:33:19 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.232576225s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 1m0.238708657s FAIL (2025-07-26 21:32:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== pb.BatchRequestItem_SegmentBegin Jul 26 21:31:42.877847417 (57h55m52.600410447s) [seg_pos={0 0}, upload=55603]: Begin upload segment... Jul 26 21:31:42.877880420 (57h55m52.60044346s) [seg_pos={0 0}, upload=55603]: Done begin upload segment. Jul 26 21:31:42.877896201 (57h55m52.600459241s) [noise=true , address=79.127.219.51:4212 , piece_id=JDWDNHN2XYUBNGB6ABIUOXXHE4VEHJ2OFLAEMHQCPLYMV6BIDJ4Q, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.878245138 (57h55m52.600808178s) [noise=true , address=104.36.82.53:4154 , piece_id=NNG7OQKHGOAGNV2FYV53IOBL6TV6L7CLTBIP73BPFORM5S2FBXTQ, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.878505667 (57h55m52.601068707s) [noise=true , address=104.36.82.40:4942 , piece_id=V62LH5T5LAS5NI6G6SK5HPRQ6JDEMVJTOZ2AVVGEG7BCVCGQV5UA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.878751487 (57h55m52.601314527s) [noise=true , address=156.146.43.225:4434 , piece_id=Z3TIFIZIFST7NRTDKDMYNJ447SYSUHXJXKTFI2LAZHSDLSUKQPDQ, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.878866617 (57h55m52.601429657s) [noise=true , address=104.36.82.19:4432 , piece_id=ZUUGGWLNS43YOKP3W3BNNKTQQ4TOA4TE4344MTKBSFYE2Q62ZUEA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.879137065 (57h55m52.601700105s) [noise=true , address=79.127.205.235:4690 , piece_id=N2Q4HYYSRIS4JRGL5DAZ2ADXB467VVI5ZLSYNVC7LSO4ETE26EEA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.879395750 (57h55m52.60195879s) [noise=true , address=104.36.82.54:4157 , piece_id=S6RHDQG3VWDGKJPKVF45EKGHO5SXWTEIBI2V6ZHUQ3B34HPTBH3A, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.879646510 (57h55m52.60220955s) [noise=true , address=79.127.201.215:4353 , piece_id=EYNR6JASXG6O2WDYN7VD4MMXO2XLPPMSX4VMK6BUQCRIMDVZ643Q, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.879886479 (57h55m52.602449519s) [noise=true , address=79.127.205.235:4668 , piece_id=7BSYNQMPKLU7I6UDT37ZC5JYBLXUQZ4N6FP6NFWZIYJW5O4TUICA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.880142409 (57h55m52.602705449s) [noise=true , address=79.127.219.38:4017 , piece_id=LTECTKX4EGOSD6CIU2UJTSF6XPJHKRZG7XVEU5NQ7GOPBZKMCZJA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.880437373 (57h55m52.603000413s) [noise=true , address=104.36.82.21:4485 , piece_id=CX4HTMIQGU5SWTIOAOIHRXGN6PGKTANEZHKPSPWSK4MF7HRHRRKQ, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.880674056 (57h55m52.603237096s) [noise=true , address=77.90.31.12:4611 , piece_id=PLCGHYXJQ6PQHZKNENCRAZU27VGHVTABUPMRJQ4AM4WLOH5DMYBA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.880924395 (57h55m52.603487435s) [noise=true , address=104.36.82.47:4544 , piece_id=VLWF7DLE6KP7UEBMKS2TYUKZ2KORYLHVZJTQG7Q7W7V6Y3MQR3UQ, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.881203739 (57h55m52.603766779s) [noise=true , address=104.36.82.7:4932 , piece_id=N4TIHZ5CM227SPM3CLVBQMDH6KJU5VYLXO25RFQEZQBYYHTYWQ6Q, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.881386870 (57h55m52.60394991s) [noise=true , address=104.36.82.46:4490 , piece_id=B55RR4PNTCE7JWPQDD3HG2VGLFLO23ETHH3I4ENJC3ROWPB3AVHQ, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.881674010 (57h55m52.60423705s) [noise=true , address=104.36.82.18:4377 , piece_id=5E3BXUBYCO73CUGZPOK4RNCGGE2V24FKAT6PFJKEAUAUEXCF34IA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.881891765 (57h55m52.604454805s) [noise=true , address=104.36.82.52:4090 , piece_id=VGTG37EHM5S5E5O7VG4JDNNBB6BHATWYMCCPLF7W2KBYL5U7BQAA, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:42.882117538 (57h55m52.604680578s) [noise=true , address=104.36.82.49:4003 , piece_id=JO2C2IQLDLNSEZDGUCE7KCKUUVG7KT2J3XGA6OO6KG64Q5OYEBCQ, seg_pos={0 0}, upload=55603]: Uploading piece... Jul 26 21:31:43.968038773 (57h55m53.690601813s) [upload=55603]: Next returned nil segment Jul 26 21:31:43.968054642 (57h55m53.690617683s) [upload=55603]: Waiting for error group managing segments... Jul 26 21:31:44.273936012 (57h55m53.996499052s) [noise=true , address=79.127.205.235:4668 , piece_id=7BSYNQMPKLU7I6UDT37ZC5JYBLXUQZ4N6FP6NFWZIYJW5O4TUICA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:31:44.275174291 (57h55m53.997737331s) [noise=true , address=79.127.205.235:4690 , piece_id=N2Q4HYYSRIS4JRGL5DAZ2ADXB467VVI5ZLSYNVC7LSO4ETE26EEA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:31:44.730769501 (57h55m54.453332551s) [noise=true , address=156.146.43.225:4434 , piece_id=Z3TIFIZIFST7NRTDKDMYNJ447SYSUHXJXKTFI2LAZHSDLSUKQPDQ, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:31:44.830817555 (57h55m54.553380595s) [noise=true , address=79.127.201.215:4353 , piece_id=EYNR6JASXG6O2WDYN7VD4MMXO2XLPPMSX4VMK6BUQCRIMDVZ643Q, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:31:45.154398949 (57h55m54.876961989s) [noise=true , address=79.127.219.51:4212 , piece_id=JDWDNHN2XYUBNGB6ABIUOXXHE4VEHJ2OFLAEMHQCPLYMV6BIDJ4Q, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:31:45.343174698 (57h55m55.065737738s) [noise=true , address=79.127.219.38:4017 , piece_id=LTECTKX4EGOSD6CIU2UJTSF6XPJHKRZG7XVEU5NQ7GOPBZKMCZJA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:31:51.342716234 (57h56m1.065279274s) [noise=true , address=104.36.82.18:4377 , piece_id=5E3BXUBYCO73CUGZPOK4RNCGGE2V24FKAT6PFJKEAUAUEXCF34IA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:31:52.859185965 (57h56m2.581748995s) [noise=true , address=77.90.31.12:4611 , piece_id=PLCGHYXJQ6PQHZKNENCRAZU27VGHVTABUPMRJQ4AM4WLOH5DMYBA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:32:03.086610257 (57h56m12.809173297s) [noise=true , address=104.36.82.21:4485 , piece_id=CX4HTMIQGU5SWTIOAOIHRXGN6PGKTANEZHKPSPWSK4MF7HRHRRKQ, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:32:05.040724663 (57h56m14.763287703s) [noise=true , address=104.36.82.49:4003 , piece_id=JO2C2IQLDLNSEZDGUCE7KCKUUVG7KT2J3XGA6OO6KG64Q5OYEBCQ, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:32:19.068240946 (57h56m28.790803986s) [noise=true , address=104.36.82.7:4932 , piece_id=N4TIHZ5CM227SPM3CLVBQMDH6KJU5VYLXO25RFQEZQBYYHTYWQ6Q, seg_pos={0 0}, upload=55603]: Done uploading piece. err: <nil> Jul 26 21:32:41.781117582 (57h56m51.503680612s) [noise=true , address=104.36.82.40:4942 , piece_id=V62LH5T5LAS5NI6G6SK5HPRQ6JDEMVJTOZ2AVVGEG7BCVCGQV5UA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: ecclient: upload failed (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7, address:104.36.82.40:4942): protocol: expected piece hash; context deadline exceeded; EOF Jul 26 21:32:41.781454416 (57h56m51.504017456s) [noise=true , address=104.36.82.46:4490 , piece_id=B55RR4PNTCE7JWPQDD3HG2VGLFLO23ETHH3I4ENJC3ROWPB3AVHQ, seg_pos={0 0}, upload=55603]: Done uploading piece. err: ecclient: upload failed (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji, address:104.36.82.46:4490): protocol: rpc: dial tcp 104.36.82.46:4490: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:41.781490846 (57h56m51.504053886s) [noise=true , address=104.36.82.52:4090 , piece_id=VGTG37EHM5S5E5O7VG4JDNNBB6BHATWYMCCPLF7W2KBYL5U7BQAA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: ecclient: upload failed (node:12UUnoD9p5FC7rq9fMSzu1phkFpsnPsu4UYxC59MhpMjJ6wUC6F, address:104.36.82.52:4090): protocol: rpc: dial tcp 104.36.82.52:4090: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:41.781526725 (57h56m51.504089765s) [noise=true , address=104.36.82.47:4544 , piece_id=VLWF7DLE6KP7UEBMKS2TYUKZ2KORYLHVZJTQG7Q7W7V6Y3MQR3UQ, seg_pos={0 0}, upload=55603]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:104.36.82.47:4544): protocol: rpc: dial tcp 104.36.82.47:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:41.781555069 (57h56m51.504118109s) [noise=true , address=104.36.82.53:4154 , piece_id=NNG7OQKHGOAGNV2FYV53IOBL6TV6L7CLTBIP73BPFORM5S2FBXTQ, seg_pos={0 0}, upload=55603]: Done uploading piece. err: ecclient: upload failed (node:1vbGunXCRMkmfvBqHPmbuW7fBLKck4Vh9MGsX1q7P6VfX6DKqB, address:104.36.82.53:4154): protocol: rpc: dial tcp 104.36.82.53:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:41.781583153 (57h56m51.504146183s) [noise=true , address=104.36.82.19:4432 , piece_id=ZUUGGWLNS43YOKP3W3BNNKTQQ4TOA4TE4344MTKBSFYE2Q62ZUEA, seg_pos={0 0}, upload=55603]: Done uploading piece. err: ecclient: upload failed (node:12oh9XZaiLhaZdMyq1cx88yrrG9C9sHtH3RTA6W2Ly39t23ArSQ, address:104.36.82.19:4432): protocol: rpc: dial tcp 104.36.82.19:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:41.781614573 (57h56m51.504177613s) [noise=true , address=104.36.82.54:4157 , piece_id=S6RHDQG3VWDGKJPKVF45EKGHO5SXWTEIBI2V6ZHUQ3B34HPTBH3A, seg_pos={0 0}, upload=55603]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:104.36.82.54:4157): protocol: write tcp 188.166.225.170:58496->104.36.82.54:4157: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:32:41.781626446 (57h56m51.504189486s) [seg_pos={0 0}, upload=55603]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 26 21:32:42.017861519 (57h56m51.740424609s) [upload=55603]: Done uploading segments... Jul 26 21:32:42.017890615 (57h56m51.740453685s) [upload=55603]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration:* 1m0.238730387s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.........X...............] duration: 1.868964656s FAIL (2025-07-26 21:32:42 UTC) orbiter warning: uplink: too many requests Duration: 1.869025963s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 9.776436285s FAIL (2025-07-26 21:32:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== true , address=104.36.82.7:4912 , piece_id=Q65VVVBKTZVJLOBYM54V4HXFL4S7C3KCPYIU5NKC4YTB4SAKP5UA, seg_pos={0 0}, upload=55548]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Jul 26 21:28:03.453885956 (57h52m13.176449046s) [seg_pos={0 0}, upload=55548]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:28:03.453992971 (57h52m13.176556061s) [upload=55548]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:28:03.454001949 (57h52m13.176565029s) [upload=55548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:28:03.877602712 (57h52m13.600165753s) [upload=55548]: Done uploading segments... Jul 26 21:28:03.877620878 (57h52m13.600183918s) [upload=55548]: Upload finished. err: <nil> Jul 26 21:29:12.291363619 (57h53m22.013926659s) [upload=55565]: Starting upload Jul 26 21:29:12.291424846 (57h53m22.013987886s) [upload=55565]: Done starting upload Jul 26 21:29:12.291476836 (57h53m22.014039886s) [upload=55565]: Uploading segments... Jul 26 21:29:12.291618597 (57h53m22.014181647s) [upload=55565]: Got next segment. Inline: false Jul 26 21:29:12.291643475 (57h53m22.014206525s) [upload=55565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:29:12.291648033 (57h53m22.014211073s) [upload=55565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:29:12.525464730 (57h53m22.24802777s) [seg_pos={0 0}, upload=55565]: Begin upload segment... Jul 26 21:29:12.525505949 (57h53m22.248068989s) [seg_pos={0 0}, upload=55565]: Done begin upload segment. Jul 26 21:29:12.525536969 (57h53m22.248100009s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.525842052 (57h53m22.248405092s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526144571 (57h53m22.248707611s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526413305 (57h53m22.248976346s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526663254 (57h53m22.249226294s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526908313 (57h53m22.249471353s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527171125 (57h53m22.249734165s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527426855 (57h53m22.249989895s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527633279 (57h53m22.250196309s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.530732579 (57h53m22.25329562s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531107997 (57h53m22.253671027s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531380879 (57h53m22.253943919s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531653471 (57h53m22.254216511s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531957172 (57h53m22.254520212s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532259030 (57h53m22.25482207s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532528335 (57h53m22.255091375s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:14.249462781 (57h53m23.972025821s) [upload=55565]: Next returned nil segment Jul 26 21:29:14.249490965 (57h53m23.972054005s) [upload=55565]: Waiting for error group managing segments... Jul 26 21:29:14.525576625 (57h53m24.248139665s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.557616257 (57h53m24.280179297s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619476866 (57h53m24.342039906s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619985460 (57h53m24.3425485s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.628053045 (57h53m24.350616085s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.642985626 (57h53m24.365548666s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.647742958 (57h53m24.370305999s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.653237842 (57h53m24.375800872s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.656914856 (57h53m24.379477897s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.705503492 (57h53m24.428066532s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:21.963538357 (57h53m31.686101397s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:29.707336511 (57h53m39.429899551s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:41.647725056 (57h53m51.370288097s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:104.36.82.12:4151): protocol: write tcp 188.166.225.170:54132->104.36.82.12:4151: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647759903 (57h53m51.370322933s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: rpc: dial tcp 104.36.82.5:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647795592 (57h53m51.370358632s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: rpc: dial tcp 104.36.82.4:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647815850 (57h53m51.37037888s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: write tcp 188.166.225.170:51486->104.36.82.15:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647844084 (57h53m51.370407124s) [seg_pos={0 0}, upload=55565]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:29:41.878479232 (57h53m51.601042332s) [upload=55565]: Done uploading segments... Jul 26 21:29:41.878514910 (57h53m51.60107801s) [upload=55565]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 9.776466092s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.....................X...................................] duration: 8.201609096s FAIL (2025-07-26 21:32:24 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 8.201647048s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 8.789430208s FAIL (2025-07-26 21:32:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== true , address=104.36.82.7:4912 , piece_id=Q65VVVBKTZVJLOBYM54V4HXFL4S7C3KCPYIU5NKC4YTB4SAKP5UA, seg_pos={0 0}, upload=55548]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Jul 26 21:28:03.453885956 (57h52m13.176449046s) [seg_pos={0 0}, upload=55548]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:28:03.453992971 (57h52m13.176556061s) [upload=55548]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:28:03.454001949 (57h52m13.176565029s) [upload=55548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:28:03.877602712 (57h52m13.600165753s) [upload=55548]: Done uploading segments... Jul 26 21:28:03.877620878 (57h52m13.600183918s) [upload=55548]: Upload finished. err: <nil> Jul 26 21:29:12.291363619 (57h53m22.013926659s) [upload=55565]: Starting upload Jul 26 21:29:12.291424846 (57h53m22.013987886s) [upload=55565]: Done starting upload Jul 26 21:29:12.291476836 (57h53m22.014039886s) [upload=55565]: Uploading segments... Jul 26 21:29:12.291618597 (57h53m22.014181647s) [upload=55565]: Got next segment. Inline: false Jul 26 21:29:12.291643475 (57h53m22.014206525s) [upload=55565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:29:12.291648033 (57h53m22.014211073s) [upload=55565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:29:12.525464730 (57h53m22.24802777s) [seg_pos={0 0}, upload=55565]: Begin upload segment... Jul 26 21:29:12.525505949 (57h53m22.248068989s) [seg_pos={0 0}, upload=55565]: Done begin upload segment. Jul 26 21:29:12.525536969 (57h53m22.248100009s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.525842052 (57h53m22.248405092s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526144571 (57h53m22.248707611s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526413305 (57h53m22.248976346s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526663254 (57h53m22.249226294s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526908313 (57h53m22.249471353s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527171125 (57h53m22.249734165s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527426855 (57h53m22.249989895s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527633279 (57h53m22.250196309s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.530732579 (57h53m22.25329562s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531107997 (57h53m22.253671027s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531380879 (57h53m22.253943919s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531653471 (57h53m22.254216511s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531957172 (57h53m22.254520212s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532259030 (57h53m22.25482207s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532528335 (57h53m22.255091375s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:14.249462781 (57h53m23.972025821s) [upload=55565]: Next returned nil segment Jul 26 21:29:14.249490965 (57h53m23.972054005s) [upload=55565]: Waiting for error group managing segments... Jul 26 21:29:14.525576625 (57h53m24.248139665s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.557616257 (57h53m24.280179297s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619476866 (57h53m24.342039906s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619985460 (57h53m24.3425485s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.628053045 (57h53m24.350616085s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.642985626 (57h53m24.365548666s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.647742958 (57h53m24.370305999s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.653237842 (57h53m24.375800872s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.656914856 (57h53m24.379477897s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.705503492 (57h53m24.428066532s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:21.963538357 (57h53m31.686101397s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:29.707336511 (57h53m39.429899551s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:41.647725056 (57h53m51.370288097s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:104.36.82.12:4151): protocol: write tcp 188.166.225.170:54132->104.36.82.12:4151: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647759903 (57h53m51.370322933s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: rpc: dial tcp 104.36.82.5:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647795592 (57h53m51.370358632s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: rpc: dial tcp 104.36.82.4:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647815850 (57h53m51.37037888s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: write tcp 188.166.225.170:51486->104.36.82.15:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647844084 (57h53m51.370407124s) [seg_pos={0 0}, upload=55565]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:29:41.878479232 (57h53m51.601042332s) [upload=55565]: Done uploading segments... Jul 26 21:29:41.878514910 (57h53m51.60107801s) [upload=55565]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 8.789448573s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 29.12406344s FAIL (2025-07-26 21:31:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== true , address=104.36.82.7:4912 , piece_id=Q65VVVBKTZVJLOBYM54V4HXFL4S7C3KCPYIU5NKC4YTB4SAKP5UA, seg_pos={0 0}, upload=55548]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Jul 26 21:28:03.453885956 (57h52m13.176449046s) [seg_pos={0 0}, upload=55548]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:28:03.453992971 (57h52m13.176556061s) [upload=55548]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:28:03.454001949 (57h52m13.176565029s) [upload=55548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:28:03.877602712 (57h52m13.600165753s) [upload=55548]: Done uploading segments... Jul 26 21:28:03.877620878 (57h52m13.600183918s) [upload=55548]: Upload finished. err: <nil> Jul 26 21:29:12.291363619 (57h53m22.013926659s) [upload=55565]: Starting upload Jul 26 21:29:12.291424846 (57h53m22.013987886s) [upload=55565]: Done starting upload Jul 26 21:29:12.291476836 (57h53m22.014039886s) [upload=55565]: Uploading segments... Jul 26 21:29:12.291618597 (57h53m22.014181647s) [upload=55565]: Got next segment. Inline: false Jul 26 21:29:12.291643475 (57h53m22.014206525s) [upload=55565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:29:12.291648033 (57h53m22.014211073s) [upload=55565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:29:12.525464730 (57h53m22.24802777s) [seg_pos={0 0}, upload=55565]: Begin upload segment... Jul 26 21:29:12.525505949 (57h53m22.248068989s) [seg_pos={0 0}, upload=55565]: Done begin upload segment. Jul 26 21:29:12.525536969 (57h53m22.248100009s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.525842052 (57h53m22.248405092s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526144571 (57h53m22.248707611s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526413305 (57h53m22.248976346s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526663254 (57h53m22.249226294s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526908313 (57h53m22.249471353s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527171125 (57h53m22.249734165s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527426855 (57h53m22.249989895s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527633279 (57h53m22.250196309s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.530732579 (57h53m22.25329562s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531107997 (57h53m22.253671027s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531380879 (57h53m22.253943919s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531653471 (57h53m22.254216511s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531957172 (57h53m22.254520212s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532259030 (57h53m22.25482207s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532528335 (57h53m22.255091375s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:14.249462781 (57h53m23.972025821s) [upload=55565]: Next returned nil segment Jul 26 21:29:14.249490965 (57h53m23.972054005s) [upload=55565]: Waiting for error group managing segments... Jul 26 21:29:14.525576625 (57h53m24.248139665s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.557616257 (57h53m24.280179297s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619476866 (57h53m24.342039906s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619985460 (57h53m24.3425485s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.628053045 (57h53m24.350616085s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.642985626 (57h53m24.365548666s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.647742958 (57h53m24.370305999s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.653237842 (57h53m24.375800872s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.656914856 (57h53m24.379477897s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.705503492 (57h53m24.428066532s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:21.963538357 (57h53m31.686101397s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:29.707336511 (57h53m39.429899551s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:41.647725056 (57h53m51.370288097s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:104.36.82.12:4151): protocol: write tcp 188.166.225.170:54132->104.36.82.12:4151: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647759903 (57h53m51.370322933s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: rpc: dial tcp 104.36.82.5:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647795592 (57h53m51.370358632s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: rpc: dial tcp 104.36.82.4:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647815850 (57h53m51.37037888s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: write tcp 188.166.225.170:51486->104.36.82.15:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647844084 (57h53m51.370407124s) [seg_pos={0 0}, upload=55565]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:29:41.878479232 (57h53m51.601042332s) [upload=55565]: Done uploading segments... Jul 26 21:29:41.878514910 (57h53m51.60107801s) [upload=55565]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 29.124081605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.....................X..................................] duration: 8.284442794s FAIL (2025-07-26 21:31:51 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 8.284464876s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.........X..............] duration: 2.055186751s FAIL (2025-07-26 21:31:35 UTC) orbiter warning: uplink: too many requests Duration: 2.055219253s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.234506544s FAIL (2025-07-26 21:31:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 6) ======LOGS====== l 26 21:30:30.093339253 (57h54m39.815902293s) [noise=true , address=104.36.82.35:4594 , piece_id=WKPFV6OLRSAMNHUQTGUF3OMFGADO4DSC5ODCFPZR4Q2SSEKZC7TA, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.093581597 (57h54m39.816144637s) [noise=true , address=104.36.82.19:4406 , piece_id=HJXFTREEKYEN5XCAXKWUG26ZUL5EFHLDZEK3G2RSQMLADLOWXGAA, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.093783383 (57h54m39.816346423s) [noise=true , address=79.127.205.233:4650 , piece_id=J3G3TXCJGFQTVMCDRJTZHCOKXBCFDE6FDTS65QBZH4LC3SAEUXSA, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.094062177 (57h54m39.816625217s) [noise=true , address=104.36.82.49:4977 , piece_id=VKYVFA7MYEESEWSOGXNJMU3AAYUOHZKTWRKJFISXXIPLUIVOFDQQ, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.094359054 (57h54m39.816922094s) [noise=true , address=79.127.205.245:4231 , piece_id=I4STLNLAOSLSWPDKH6LIUTPGNVHPZMXYVTSDGAOM7FAZ3CAQYFPQ, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.094609564 (57h54m39.817172604s) [noise=true , address=104.36.82.56:4244 , piece_id=XIZIXE4OBVOBANECIQM2CUV7WGKSMWEMGXAZBPTKVI3QSGZMCAQA, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.094794858 (57h54m39.817357898s) [noise=true , address=104.36.82.15:4271 , piece_id=2JQOR3SOWRUPLX7V5IG3C754RCHGPYJOYTLTBPY2EWER6HXDSOOA, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.095004850 (57h54m39.81756789s) [noise=true , address=104.36.82.54:4185 , piece_id=WJZR4LYXLIRUHIOAIZ6ZQGNWN3TVQAKMGRBSR5GQWHWTBJGERJWA, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.095189043 (57h54m39.817752083s) [noise=true , address=104.36.82.14:4224 , piece_id=T2KHUJLHQVK5SOLPBDXZ3A62POT7LJVIWBVT6ZELJDPBD67M6ANQ, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.095374327 (57h54m39.817937367s) [noise=true , address=104.36.82.41:4794 , piece_id=HEOTWBHEJMALVOE2NEDWSQZADMS76OXOQ3ZGMZ23UXQ5YAQ3CMGA, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.095593807 (57h54m39.818156847s) [noise=true , address=104.36.82.53:4154 , piece_id=FLWK3MITJNY6P7ZSCUXI6ZMK62HAMOA4TTDSAZ7HO42GCJ6KELEQ, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.095775325 (57h54m39.818338355s) [noise=true , address=104.36.82.2:4752 , piece_id=EY7N3GA7UXT4FAZ7PQZLPSAUYEWQ6AY2NHE7RYFGBU2WUYWVSEVQ, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:30.095956190 (57h54m39.81851923s) [noise=true , address=79.127.205.234:4589 , piece_id=LUXABZ2XEL4S7REWKXBMNSNWKSVSJJ5TGJV6S6E6LKBFNIO7B4OQ, seg_pos={0 0}, upload=55586]: Uploading piece... Jul 26 21:30:31.187769399 (57h54m40.910332429s) [upload=55586]: Next returned nil segment Jul 26 21:30:31.187788266 (57h54m40.910351306s) [upload=55586]: Waiting for error group managing segments... Jul 26 21:30:31.477896355 (57h54m41.200459395s) [noise=true , address=79.127.205.234:4589 , piece_id=LUXABZ2XEL4S7REWKXBMNSNWKSVSJJ5TGJV6S6E6LKBFNIO7B4OQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: <nil> Jul 26 21:30:31.502402824 (57h54m41.224965864s) [noise=true , address=79.127.205.245:4231 , piece_id=I4STLNLAOSLSWPDKH6LIUTPGNVHPZMXYVTSDGAOM7FAZ3CAQYFPQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: <nil> Jul 26 21:30:31.517528353 (57h54m41.240091393s) [noise=true , address=79.127.205.233:4650 , piece_id=J3G3TXCJGFQTVMCDRJTZHCOKXBCFDE6FDTS65QBZH4LC3SAEUXSA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: <nil> Jul 26 21:30:35.318584763 (57h54m45.041147803s) [noise=true , address=79.127.201.215:4353 , piece_id=YVQ4HRSLPAM67K4PBQZT6V3RNJO5VVEOCPJFBBU6A7VVHAXOAS6Q, seg_pos={0 0}, upload=55586]: Done uploading piece. err: <nil> Jul 26 21:30:35.563551092 (57h54m45.286114132s) [noise=true , address=77.90.31.18:4823 , piece_id=AWRZ527SLDX43HTNEAQSMEQQJ5CXZFCGY6BS4C3RGHJJGSPWEBDQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: <nil> Jul 26 21:31:01.615682666 (57h55m11.338245706s) [noise=true , address=104.36.82.51:4061 , piece_id=RD6YPZR7DOBLGE45DKQXVZ3CYBL6TKDMUYQ2SQIQX7YA3BZZLEHQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: <nil> Jul 26 21:31:28.998365914 (57h55m38.720928944s) [noise=true , address=104.36.82.54:4185 , piece_id=WJZR4LYXLIRUHIOAIZ6ZQGNWN3TVQAKMGRBSR5GQWHWTBJGERJWA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:1cLdyyVLrp1yBmgsfBrfYc6N2RFbBichYoBbo2F7EZfaBXtkfk, address:104.36.82.54:4185): protocol: rpc: dial tcp 104.36.82.54:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998411722 (57h55m38.720974762s) [noise=true , address=104.36.82.14:4224 , piece_id=T2KHUJLHQVK5SOLPBDXZ3A62POT7LJVIWBVT6ZELJDPBD67M6ANQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:104.36.82.14:4224): protocol: rpc: dial tcp 104.36.82.14:4224: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998443754 (57h55m38.721006794s) [noise=true , address=104.36.82.41:4794 , piece_id=HEOTWBHEJMALVOE2NEDWSQZADMS76OXOQ3ZGMZ23UXQ5YAQ3CMGA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:12R7HqLyfJRftdvi2pD81NNrRVVnCEyKT9nrzv8eUWU4j2WGmzw, address:104.36.82.41:4794): protocol: rpc: dial tcp 104.36.82.41:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998475765 (57h55m38.721038805s) [noise=true , address=104.36.82.35:4594 , piece_id=WKPFV6OLRSAMNHUQTGUF3OMFGADO4DSC5ODCFPZR4Q2SSEKZC7TA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf, address:104.36.82.35:4594): protocol: write tcp 188.166.225.170:40868->104.36.82.35:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998504379 (57h55m38.721067419s) [noise=true , address=104.36.82.19:4406 , piece_id=HJXFTREEKYEN5XCAXKWUG26ZUL5EFHLDZEK3G2RSQMLADLOWXGAA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:104.36.82.19:4406): protocol: write tcp 188.166.225.170:59836->104.36.82.19:4406: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998531421 (57h55m38.721094461s) [noise=true , address=104.36.82.15:4271 , piece_id=2JQOR3SOWRUPLX7V5IG3C754RCHGPYJOYTLTBPY2EWER6HXDSOOA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:1T9uQjynbTYcaixhvHWCKzatRWpFxMonHFi5idiMQtvivupKSu, address:104.36.82.15:4271): protocol: rpc: dial tcp 104.36.82.15:4271: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998649949 (57h55m38.721212989s) [noise=true , address=104.36.82.2:4752 , piece_id=EY7N3GA7UXT4FAZ7PQZLPSAUYEWQ6AY2NHE7RYFGBU2WUYWVSEVQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:12oRYWQwoe5JtDCqfSShqtyRWVQLjL4UtbokBgNpDAocBKv1vqL, address:104.36.82.2:4752): protocol: context deadline exceeded; context deadline exceeded Jul 26 21:31:28.998813161 (57h55m38.721376191s) [noise=true , address=104.36.82.49:4977 , piece_id=VKYVFA7MYEESEWSOGXNJMU3AAYUOHZKTWRKJFISXXIPLUIVOFDQQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8, address:104.36.82.49:4977): protocol: write tcp 188.166.225.170:40610->104.36.82.49:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998859840 (57h55m38.72142288s) [noise=true , address=104.36.82.46:4490 , piece_id=6PGLNNOZVK2MXVTUW23TTAEIT5AREQBZEHO5MDO76QZO5BKVWTUA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji, address:104.36.82.46:4490): protocol: write tcp 188.166.225.170:44622->104.36.82.46:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998890598 (57h55m38.721453638s) [noise=true , address=104.36.82.53:4154 , piece_id=FLWK3MITJNY6P7ZSCUXI6ZMK62HAMOA4TTDSAZ7HO42GCJ6KELEQ, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:1vbGunXCRMkmfvBqHPmbuW7fBLKck4Vh9MGsX1q7P6VfX6DKqB, address:104.36.82.53:4154): protocol: rpc: dial tcp 104.36.82.53:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.998981904 (57h55m38.721544944s) [noise=true , address=104.36.82.56:4244 , piece_id=XIZIXE4OBVOBANECIQM2CUV7WGKSMWEMGXAZBPTKVI3QSGZMCAQA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:12S1wh3PFQLPosjWmPs5iLfm4S5J6abXvoCfkhYz3KdvXCTaPRu, address:104.36.82.56:4244): protocol: write tcp 188.166.225.170:48816->104.36.82.56:4244: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:31:28.999051176 (57h55m38.721614216s) [noise=true , address=104.36.82.7:4922 , piece_id=N26HYZVZWZ4QQISQ6LO35JBVWXONXQIK6RH5VLKGZOCLLHOZQ5HA, seg_pos={0 0}, upload=55586]: Done uploading piece. err: ecclient: upload failed (node:12KrMgT4Pwj9UFE88q6tt65D7o6q68NhsmEXmifNmvzJ6eEkm8R, address:104.36.82.7:4922): protocol: write tcp 188.166.225.170:42460->104.36.82.7:4922: use of closed network connection; conn closed: op Jul 26 21:31:28.999063750 (57h55m38.72162679s) [seg_pos={0 0}, upload=55586]: Done waiting for segment. successful: 6 optimal: 14 errs: <nil> Jul 26 21:31:29.231246921 (57h55m38.953809961s) [upload=55586]: Done uploading segments... Jul 26 21:31:29.231272761 (57h55m38.953835801s) [upload=55586]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 6) Duration: 1m0.234518887s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.........X.............] duration: 1.912007876s FAIL (2025-07-26 21:31:08 UTC) orbiter warning: uplink: too many requests Duration: 1.912035247s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.....................X.................................] duration: 21.297552396s FAIL (2025-07-26 21:30:54 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 21.297581771s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.........X............] duration: 1.926397987s FAIL (2025-07-26 21:30:31 UTC) orbiter warning: uplink: too many requests Duration: 1.926422984s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 12.779991095s FAIL (2025-07-26 21:30:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== true , address=104.36.82.7:4912 , piece_id=Q65VVVBKTZVJLOBYM54V4HXFL4S7C3KCPYIU5NKC4YTB4SAKP5UA, seg_pos={0 0}, upload=55548]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Jul 26 21:28:03.453885956 (57h52m13.176449046s) [seg_pos={0 0}, upload=55548]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:28:03.453992971 (57h52m13.176556061s) [upload=55548]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:28:03.454001949 (57h52m13.176565029s) [upload=55548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:28:03.877602712 (57h52m13.600165753s) [upload=55548]: Done uploading segments... Jul 26 21:28:03.877620878 (57h52m13.600183918s) [upload=55548]: Upload finished. err: <nil> Jul 26 21:29:12.291363619 (57h53m22.013926659s) [upload=55565]: Starting upload Jul 26 21:29:12.291424846 (57h53m22.013987886s) [upload=55565]: Done starting upload Jul 26 21:29:12.291476836 (57h53m22.014039886s) [upload=55565]: Uploading segments... Jul 26 21:29:12.291618597 (57h53m22.014181647s) [upload=55565]: Got next segment. Inline: false Jul 26 21:29:12.291643475 (57h53m22.014206525s) [upload=55565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:29:12.291648033 (57h53m22.014211073s) [upload=55565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:29:12.525464730 (57h53m22.24802777s) [seg_pos={0 0}, upload=55565]: Begin upload segment... Jul 26 21:29:12.525505949 (57h53m22.248068989s) [seg_pos={0 0}, upload=55565]: Done begin upload segment. Jul 26 21:29:12.525536969 (57h53m22.248100009s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.525842052 (57h53m22.248405092s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526144571 (57h53m22.248707611s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526413305 (57h53m22.248976346s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526663254 (57h53m22.249226294s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526908313 (57h53m22.249471353s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527171125 (57h53m22.249734165s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527426855 (57h53m22.249989895s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527633279 (57h53m22.250196309s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.530732579 (57h53m22.25329562s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531107997 (57h53m22.253671027s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531380879 (57h53m22.253943919s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531653471 (57h53m22.254216511s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531957172 (57h53m22.254520212s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532259030 (57h53m22.25482207s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532528335 (57h53m22.255091375s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:14.249462781 (57h53m23.972025821s) [upload=55565]: Next returned nil segment Jul 26 21:29:14.249490965 (57h53m23.972054005s) [upload=55565]: Waiting for error group managing segments... Jul 26 21:29:14.525576625 (57h53m24.248139665s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.557616257 (57h53m24.280179297s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619476866 (57h53m24.342039906s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619985460 (57h53m24.3425485s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.628053045 (57h53m24.350616085s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.642985626 (57h53m24.365548666s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.647742958 (57h53m24.370305999s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.653237842 (57h53m24.375800872s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.656914856 (57h53m24.379477897s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.705503492 (57h53m24.428066532s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:21.963538357 (57h53m31.686101397s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:29.707336511 (57h53m39.429899551s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:41.647725056 (57h53m51.370288097s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:104.36.82.12:4151): protocol: write tcp 188.166.225.170:54132->104.36.82.12:4151: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647759903 (57h53m51.370322933s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: rpc: dial tcp 104.36.82.5:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647795592 (57h53m51.370358632s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: rpc: dial tcp 104.36.82.4:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647815850 (57h53m51.37037888s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: write tcp 188.166.225.170:51486->104.36.82.15:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647844084 (57h53m51.370407124s) [seg_pos={0 0}, upload=55565]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:29:41.878479232 (57h53m51.601042332s) [upload=55565]: Done uploading segments... Jul 26 21:29:41.878514910 (57h53m51.60107801s) [upload=55565]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 12.780025572s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.232983436s FAIL (2025-07-26 21:30:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== .BatchRequestItem_SegmentBegin Jul 26 21:29:29.682232418 (57h53m39.404795458s) [seg_pos={0 0}, upload=55572]: Begin upload segment... Jul 26 21:29:29.682268398 (57h53m39.404831428s) [seg_pos={0 0}, upload=55572]: Done begin upload segment. Jul 26 21:29:29.682288295 (57h53m39.404851335s) [noise=true , address=104.36.82.10:4094 , piece_id=6N6C26FSLFVIZ7AUQXYXUVAQ4FNXHVGGJ2ML4LRPSZP6S45B7XIQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.682320076 (57h53m39.404883116s) [noise=true , address=64.49.13.155:4923 , piece_id=WWFAG46G3GVLZWUDA4OIXZXZ5QPI554HKWJ7SFYZ26JEK47QWEBA, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.682635109 (57h53m39.405198149s) [noise=true , address=104.36.82.47:4531 , piece_id=P2BLOWSMRNUTNYBYMDEZPBLYXN5FFKYPRQ3WQ2BI7T23VZD6WUOQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.682747293 (57h53m39.405310333s) [noise=true , address=104.36.82.11:4133 , piece_id=MZAD6C2LQURQQ6DCB23EQYB5BCV3YAZHL7LERNZ437CWMCQ3DRJQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.682922138 (57h53m39.405485178s) [noise=true , address=79.127.205.234:4614 , piece_id=XNO5RB6FJAUSSTVPQO56NNFSMQFHIVR7LDKNZRDFHN3QGDE6WX3A, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683033010 (57h53m39.40559604s) [noise=true , address=104.36.82.53:4134 , piece_id=3FEGSEF3EODMXIG7S7NIOK7CGIFOZVD7N7KZXNVTPMLM5U6NCXFQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683207815 (57h53m39.405770845s) [noise=true , address=104.36.82.12:4177 , piece_id=6POZ6ZOSA6X5BAXEIYA4SZH43G7XHI5I2RSISY56U4XDRR37EGEQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683424880 (57h53m39.40598792s) [noise=true , address=79.127.201.215:4343 , piece_id=GVAPQ75JJQWIR44XQ2ONKYBXTLFVHDQ26C2PTOU2W3U7MEVXTK3A, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683469866 (57h53m39.406032906s) [noise=true , address=156.146.43.225:4448 , piece_id=X7CR2I3ICGMVFMUFYCW6CX4NK7VDLLJHGIGCSV6C54IYLRBITC7A, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683681230 (57h53m39.40624427s) [noise=true , address=104.36.82.38:4690 , piece_id=FO3WC3YYIOBGPJLXGYKW22LHJ2FEAGEGUYFAUOOOITQA25RQ7AYA, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683702531 (57h53m39.406265571s) [noise=true , address=79.127.205.233:4643 , piece_id=UQ3BG7HEZZLQZDINIBHIFGVWE3LIDIVKRVZMBODB7JNUY27F3VAQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683889178 (57h53m39.406452208s) [noise=true , address=79.127.205.245:4239 , piece_id=YNVIH24MMSHDF7W3JDOH5VZQHGVX4NFDOP3DBAGDLNBNP5PHWB7Q, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.683966095 (57h53m39.406529135s) [noise=true , address=104.36.82.54:4168 , piece_id=Y7VNCYIBRBVBSD2QPQQTQM6QJXLE36SRRVHLJBGEBHP22XFPI5CQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.684127424 (57h53m39.406690464s) [noise=true , address=104.36.82.42:4820 , piece_id=P4D3TQ55CEAF6RGTNLGGETFVVLGXREVXUULVEBTQSUFWYSMDQPJA, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.684246050 (57h53m39.406809091s) [noise=true , address=104.36.82.18:4377 , piece_id=BGWAXFKFXZR644YSHKFWBNGNLO47NPRI3MAYTVFYGOV5U3ZRUBKA, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.684370679 (57h53m39.406933729s) [noise=true , address=104.36.82.55:4201 , piece_id=3W6N3LNHGFNPXSAJNQYV7QMJMKYBBPLHN2TAA2LAYAWKB3HVS3XQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.684523963 (57h53m39.407087003s) [noise=true , address=104.36.82.45:4908 , piece_id=NFVW7DE232YGHNEISDTLX3WCQYEQ55WKAFIM2VFJYWPL4UDIJCVQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:29.684566554 (57h53m39.407129594s) [noise=true , address=79.127.205.246:4262 , piece_id=BTEXUWAGT3JDBFAZUWCXIR5PO25UBTBJMCNDCWE5CY3BEO3NKQHQ, seg_pos={0 0}, upload=55572]: Uploading piece... Jul 26 21:29:30.793534194 (57h53m40.516097234s) [upload=55572]: Next returned nil segment Jul 26 21:29:30.793552670 (57h53m40.51611571s) [upload=55572]: Waiting for error group managing segments... Jul 26 21:29:31.115402762 (57h53m40.837965802s) [noise=true , address=79.127.205.245:4239 , piece_id=YNVIH24MMSHDF7W3JDOH5VZQHGVX4NFDOP3DBAGDLNBNP5PHWB7Q, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:29:31.128515521 (57h53m40.851078561s) [noise=true , address=79.127.205.246:4262 , piece_id=BTEXUWAGT3JDBFAZUWCXIR5PO25UBTBJMCNDCWE5CY3BEO3NKQHQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:29:31.308389558 (57h53m41.030952598s) [noise=true , address=64.49.13.155:4923 , piece_id=WWFAG46G3GVLZWUDA4OIXZXZ5QPI554HKWJ7SFYZ26JEK47QWEBA, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:29:31.427782795 (57h53m41.150345835s) [noise=true , address=79.127.205.233:4643 , piece_id=UQ3BG7HEZZLQZDINIBHIFGVWE3LIDIVKRVZMBODB7JNUY27F3VAQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:29:31.599514985 (57h53m41.322078025s) [noise=true , address=156.146.43.225:4448 , piece_id=X7CR2I3ICGMVFMUFYCW6CX4NK7VDLLJHGIGCSV6C54IYLRBITC7A, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:29:31.748518606 (57h53m41.471081646s) [noise=true , address=79.127.201.215:4343 , piece_id=GVAPQ75JJQWIR44XQ2ONKYBXTLFVHDQ26C2PTOU2W3U7MEVXTK3A, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:29:31.933558647 (57h53m41.656121687s) [noise=true , address=79.127.205.234:4614 , piece_id=XNO5RB6FJAUSSTVPQO56NNFSMQFHIVR7LDKNZRDFHN3QGDE6WX3A, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:30:08.461851821 (57h54m18.184414871s) [noise=true , address=104.36.82.10:4094 , piece_id=6N6C26FSLFVIZ7AUQXYXUVAQ4FNXHVGGJ2ML4LRPSZP6S45B7XIQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:30:10.758600468 (57h54m20.481163508s) [noise=true , address=104.36.82.38:4690 , piece_id=FO3WC3YYIOBGPJLXGYKW22LHJ2FEAGEGUYFAUOOOITQA25RQ7AYA, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:30:24.127989470 (57h54m33.85055251s) [noise=true , address=104.36.82.12:4177 , piece_id=6POZ6ZOSA6X5BAXEIYA4SZH43G7XHI5I2RSISY56U4XDRR37EGEQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:30:25.943061993 (57h54m35.665625023s) [noise=true , address=104.36.82.11:4133 , piece_id=MZAD6C2LQURQQ6DCB23EQYB5BCV3YAZHL7LERNZ437CWMCQ3DRJQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: <nil> Jul 26 21:30:28.525734062 (57h54m38.248297102s) [noise=true , address=104.36.82.55:4201 , piece_id=3W6N3LNHGFNPXSAJNQYV7QMJMKYBBPLHN2TAA2LAYAWKB3HVS3XQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: ecclient: upload failed (node:12bPDvhDfu8Z58LxZcicg1vAiiu1sZYGpwQnvuhk4t5m6yR87Fi, address:104.36.82.55:4201): protocol: rpc: dial tcp 104.36.82.55:4201: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:30:28.525791722 (57h54m38.248354762s) [noise=true , address=104.36.82.54:4168 , piece_id=Y7VNCYIBRBVBSD2QPQQTQM6QJXLE36SRRVHLJBGEBHP22XFPI5CQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: ecclient: upload failed (node:1XH68Yk8yh2Qa8vcPRYAuLHdGR7Jy4KtSBKYKgwAJpdDvVu7up, address:104.36.82.54:4168): protocol: rpc: dial tcp 104.36.82.54:4168: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:30:28.525918345 (57h54m38.248481385s) [noise=true , address=104.36.82.42:4820 , piece_id=P4D3TQ55CEAF6RGTNLGGETFVVLGXREVXUULVEBTQSUFWYSMDQPJA, seg_pos={0 0}, upload=55572]: Done uploading piece. err: ecclient: upload failed (node:12rWzLpDf6jtpMcAFyF4WWUgcWV6cJMKNWRo6wZYvtZ1rDoQ1Hh, address:104.36.82.42:4820): protocol: context deadline exceeded; context deadline exceeded Jul 26 21:30:28.526082058 (57h54m38.248645098s) [noise=true , address=104.36.82.18:4377 , piece_id=BGWAXFKFXZR644YSHKFWBNGNLO47NPRI3MAYTVFYGOV5U3ZRUBKA, seg_pos={0 0}, upload=55572]: Done uploading piece. err: ecclient: upload failed (node:1JHy4o8dxFNeeiitLPavxspcf4rL9KfckcRAuC121v8YZG6qmT, address:104.36.82.18:4377): protocol: rpc: dial tcp 104.36.82.18:4377: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:30:28.526135821 (57h54m38.248698861s) [noise=true , address=104.36.82.45:4908 , piece_id=NFVW7DE232YGHNEISDTLX3WCQYEQ55WKAFIM2VFJYWPL4UDIJCVQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:104.36.82.45:4908): protocol: rpc: dial tcp 104.36.82.45:4908: i/o timeout; context deadline exceeded Jul 26 21:30:28.526261281 (57h54m38.248824321s) [noise=true , address=104.36.82.47:4531 , piece_id=P2BLOWSMRNUTNYBYMDEZPBLYXN5FFKYPRQ3WQ2BI7T23VZD6WUOQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: ecclient: upload failed (node:12LZprfyqfD2YUwgAarzyjbgHEb6jMhAMAday5C45xk3j9RUS4u, address:104.36.82.47:4531): protocol: write tcp 188.166.225.170:39958->104.36.82.47:4531: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:30:28.526313771 (57h54m38.248876811s) [noise=true , address=104.36.82.53:4134 , piece_id=3FEGSEF3EODMXIG7S7NIOK7CGIFOZVD7N7KZXNVTPMLM5U6NCXFQ, seg_pos={0 0}, upload=55572]: Done uploading piece. err: ecclient: upload failed (node:1q1d7zN2HvDrwEjrJEsGpXxx2aMRTiuj4zwedLAxZGhCzuvNgL, address:104.36.82.53:4134): protocol: write tcp 188.166.225.170:39288->104.36.82.53:4134: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:30:28.526339220 (57h54m38.24890226s) [seg_pos={0 0}, upload=55572]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 26 21:30:28.756877814 (57h54m38.479440844s) [upload=55572]: Done uploading segments... Jul 26 21:30:28.756888143 (57h54m38.479451183s) [upload=55572]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.233002885s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.....................X................................] duration: 23.685946975s FAIL (2025-07-26 21:30:11 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 23.685978877s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.232503326s FAIL (2025-07-26 21:29:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== true , address=104.36.82.7:4912 , piece_id=Q65VVVBKTZVJLOBYM54V4HXFL4S7C3KCPYIU5NKC4YTB4SAKP5UA, seg_pos={0 0}, upload=55548]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Jul 26 21:28:03.453885956 (57h52m13.176449046s) [seg_pos={0 0}, upload=55548]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 26 21:28:03.453992971 (57h52m13.176556061s) [upload=55548]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 26 21:28:03.454001949 (57h52m13.176565029s) [upload=55548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 26 21:28:03.877602712 (57h52m13.600165753s) [upload=55548]: Done uploading segments... Jul 26 21:28:03.877620878 (57h52m13.600183918s) [upload=55548]: Upload finished. err: <nil> Jul 26 21:29:12.291363619 (57h53m22.013926659s) [upload=55565]: Starting upload Jul 26 21:29:12.291424846 (57h53m22.013987886s) [upload=55565]: Done starting upload Jul 26 21:29:12.291476836 (57h53m22.014039886s) [upload=55565]: Uploading segments... Jul 26 21:29:12.291618597 (57h53m22.014181647s) [upload=55565]: Got next segment. Inline: false Jul 26 21:29:12.291643475 (57h53m22.014206525s) [upload=55565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 21:29:12.291648033 (57h53m22.014211073s) [upload=55565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 21:29:12.525464730 (57h53m22.24802777s) [seg_pos={0 0}, upload=55565]: Begin upload segment... Jul 26 21:29:12.525505949 (57h53m22.248068989s) [seg_pos={0 0}, upload=55565]: Done begin upload segment. Jul 26 21:29:12.525536969 (57h53m22.248100009s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.525842052 (57h53m22.248405092s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526144571 (57h53m22.248707611s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526413305 (57h53m22.248976346s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526663254 (57h53m22.249226294s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.526908313 (57h53m22.249471353s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527171125 (57h53m22.249734165s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527426855 (57h53m22.249989895s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.527633279 (57h53m22.250196309s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.530732579 (57h53m22.25329562s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531107997 (57h53m22.253671027s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531380879 (57h53m22.253943919s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531653471 (57h53m22.254216511s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.531957172 (57h53m22.254520212s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532259030 (57h53m22.25482207s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:12.532528335 (57h53m22.255091375s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Uploading piece... Jul 26 21:29:14.249462781 (57h53m23.972025821s) [upload=55565]: Next returned nil segment Jul 26 21:29:14.249490965 (57h53m23.972054005s) [upload=55565]: Waiting for error group managing segments... Jul 26 21:29:14.525576625 (57h53m24.248139665s) [noise=true , address=45.91.116.13:4153 , piece_id=77UYAH7WPPQ6RJWRRCYOY7LRSMRHIR7WFYLR4EP65DMCKNQLYNLA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.557616257 (57h53m24.280179297s) [noise=true , address=45.91.116.4:4940 , piece_id=IQPHTBFUGHJZJ6OOPG2TITFJYHW3TS43ITPJTB5BCQPIL5DTZ7QQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619476866 (57h53m24.342039906s) [noise=true , address=45.91.116.6:4973 , piece_id=S2W3CP33U5GOOK674MRIESPKLBMC3WDXV4UZ4SCRUUFF5OWLXVKQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.619985460 (57h53m24.3425485s) [noise=true , address=45.91.116.8:4048 , piece_id=4OLBHXX4RX5KNA76QZ2HXQGSO5STSJJCYRGYX6N7MU7AS7MYCDYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.628053045 (57h53m24.350616085s) [noise=true , address=45.91.116.12:4227 , piece_id=L62H3UUWVBZF55L3AUJLG2QXS27QF4NOC6TJ2ISOLLTHVF5V5LSA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.642985626 (57h53m24.365548666s) [noise=true , address=45.91.116.7:4011 , piece_id=NHSEPU764CIJKJACYKK3HUDVKAFBQD4CYDT57YJSTZWA3VFBGQAQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.647742958 (57h53m24.370305999s) [noise=true , address=45.91.116.13:4154 , piece_id=PUSNHJTSVQKWEBAOJNQBJZZ6GMTLDFYVPTNHDRR5DZRVZAZHADNA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.653237842 (57h53m24.375800872s) [noise=true , address=45.91.116.14:4190 , piece_id=EOZLRX5S3QXA5RJCFCNDHMNWUGV36TVHBT2WDFEP6T63HFHXRYYA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.656914856 (57h53m24.379477897s) [noise=true , address=45.91.116.10:4081 , piece_id=QBI5VXR5ZGPVXESAPL7VYXVSPZOABLL5CAECA2CNDO57VF7XXKWQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:14.705503492 (57h53m24.428066532s) [noise=true , address=45.91.116.11:4118 , piece_id=LZW5XT2CFQVX5WHZ5JGADQKGJK7K5ODW54DJAU5BRREM735TNZGA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:21.963538357 (57h53m31.686101397s) [noise=true , address=77.90.31.16:4735 , piece_id=DKVQY5IZWS5AKEVM4R66VUOAPXSFUKPS5GRVY74IMYUEIRPXIUTA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:29.707336511 (57h53m39.429899551s) [noise=true , address=77.90.31.14:4661 , piece_id=Q6L7KYUJAOQVLZ3MNMF5CTVYTRIUIL7N3IG76MB33MGZ4A5E7Q7Q, seg_pos={0 0}, upload=55565]: Done uploading piece. err: <nil> Jul 26 21:29:41.647725056 (57h53m51.370288097s) [noise=true , address=104.36.82.12:4151 , piece_id=ASR2C7JW55LZ52KVMAOZLQM6NABWVHUFJT2TPHPTU47HWH53MBCQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:104.36.82.12:4151): protocol: write tcp 188.166.225.170:54132->104.36.82.12:4151: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647759903 (57h53m51.370322933s) [noise=true , address=104.36.82.5:4838 , piece_id=VD7MSDATYKFSHNII2BQNUM5CJELV2WVVLFFABDMNLNK4SQRUMZJQ, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:104.36.82.5:4838): protocol: rpc: dial tcp 104.36.82.5:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647795592 (57h53m51.370358632s) [noise=true , address=104.36.82.4:4801 , piece_id=UE2C7GSFFLE2FE6RZDDHW5WN2FLX4QB66XPMINYHQHZOTKMHQ5YA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: rpc: dial tcp 104.36.82.4:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647815850 (57h53m51.37037888s) [noise=true , address=104.36.82.15:4259 , piece_id=VYYIUHONG3ZOD72D7RHEQJ25LEFIJAHVQ2O346BTZBMEHEJE46TA, seg_pos={0 0}, upload=55565]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: write tcp 188.166.225.170:51486->104.36.82.15:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:41.647844084 (57h53m51.370407124s) [seg_pos={0 0}, upload=55565]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 26 21:29:41.878479232 (57h53m51.601042332s) [upload=55565]: Done uploading segments... Jul 26 21:29:41.878514910 (57h53m51.60107801s) [upload=55565]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.232526581s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.....................X...............................] duration: 12.528605511s FAIL (2025-07-26 21:29:39 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 12.528626702s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X......X.....................X..............................] duration: 20.675943481s FAIL (2025-07-26 21:29:26 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 20.675969741s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.........X...........] duration: 1.834383473s FAIL (2025-07-26 21:29:22 UTC) orbiter warning: uplink: too many requests Duration: 1.834408712s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.242628844s FAIL (2025-07-26 21:29:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== g piece... Jul 26 21:28:18.543208534 (57h52m28.265771584s) [noise=true , address=104.36.82.5:4865 , piece_id=5HRGL4QISNOBRDSKXMKE3M4KMU4YIJVVZYGKT6QTRBOKHFQXZ4GQ, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.543654357 (57h52m28.266217427s) [noise=true , address=79.127.201.214:4317 , piece_id=CNCYGERXAVMLG3SCBV62ESHL27RUPJ43TQFVKL3ZCKYF7YNQPSMA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.543820595 (57h52m28.266383635s) [noise=true , address=104.36.82.47:4538 , piece_id=QXFDEXKHWVRFQ3RMBOWDLXPUT333VBPZZS2BWTY6AQ7JLMSJ76IA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.543981513 (57h52m28.266544553s) [noise=true , address=77.90.31.13:4653 , piece_id=2XSRTZGYDGRSJOMMINHGWBABJRO4FND22VADVFMGMVTSQ4EON5SQ, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.544242552 (57h52m28.266805612s) [noise=true , address=104.36.82.14:4248 , piece_id=LU6G7ESP4XOXRA5MMISCEABTKMOKUAVKNM3HTTKUM5R3H3QP5ZWQ, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.544313267 (57h52m28.266876347s) [noise=true , address=79.127.201.215:4351 , piece_id=2HEWWASOEKRJTBFAOYLW5HYTHXGA7RR7AOKB5E4OKULT2XUWKJXQ, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.544618100 (57h52m28.26718114s) [noise=true , address=104.36.82.54:4180 , piece_id=RDVRHQMV7JATSC3OFZIAIMJNBUBCTQOSA5XSJUY4DMRXOO2LEZ4A, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.544626887 (57h52m28.267189927s) [noise=true , address=77.90.31.15:4717 , piece_id=EBRL2LQLZBMKN3ZKBUMW32FOP3WYFRMSDZDGBVIERZDOYOPZHRQA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.544658127 (57h52m28.267221167s) [noise=true , address=79.127.205.235:4687 , piece_id=JBR4JE34VSDYMLE423TMAEGSN3BBDZ3YIKUSVXY7QZV4XOZETBGQ, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.544873559 (57h52m28.267436599s) [noise=true , address=64.49.13.140:4508 , piece_id=K7UHHOEM7KAV65RFOKAHAUG6XXOU6YA6BVCUIAUAYV54DHU3XYPA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.545078271 (57h52m28.267641301s) [noise=true , address=104.36.82.46:4515 , piece_id=LK5M7QLDLNT4IRK6S5JT4WON34AESKHRM5JTYRSVZ4FVC3LGW6RQ, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.545286810 (57h52m28.26784985s) [noise=true , address=104.36.82.42:4809 , piece_id=7MZWXYWGKXOUR23WBWIV6S36XYIGL2BMZBDVXZUYTHTPWSFGQ4JA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.545492664 (57h52m28.268055694s) [noise=true , address=64.49.13.155:4923 , piece_id=3JXZLLI5YFD3NNWSY37KAX7HTQRB3GZZOPRAFRVXT676UKBGLVWA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.545791696 (57h52m28.268354736s) [noise=true , address=79.127.219.51:4201 , piece_id=OWW7RWZKDL5LZ4J36EWPROBWTAZOL3SIUPD7IM57G3T5NHURL2NA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.546133239 (57h52m28.268696279s) [noise=true , address=79.127.205.234:4606 , piece_id=WBV7NGGU7GFXDQFDPXV4OXVN3IQ2KJVB7ECFD2XORKRCE7XQXCLA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.548586743 (57h52m28.271149793s) [noise=true , address=104.36.82.52:4101 , piece_id=XAQGBFNDEURR5VILRF4N64TCWAHOXOTWNHPXZ3JEV3CXULY26KJA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:18.548986038 (57h52m28.271549088s) [noise=true , address=64.49.13.140:4514 , piece_id=2UB7SI2U4XVYCDGKZJO5IH6D273RDGRNPQLDHQSOPRKR2XCACSEA, seg_pos={0 0}, upload=55554]: Uploading piece... Jul 26 21:28:19.629269316 (57h52m29.351832356s) [upload=55554]: Next returned nil segment Jul 26 21:28:19.629290918 (57h52m29.351853958s) [upload=55554]: Waiting for error group managing segments... Jul 26 21:28:19.958716674 (57h52m29.681279714s) [noise=true , address=79.127.205.234:4606 , piece_id=WBV7NGGU7GFXDQFDPXV4OXVN3IQ2KJVB7ECFD2XORKRCE7XQXCLA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:19.984127163 (57h52m29.706690203s) [noise=true , address=64.49.13.140:4514 , piece_id=2UB7SI2U4XVYCDGKZJO5IH6D273RDGRNPQLDHQSOPRKR2XCACSEA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:20.254157569 (57h52m29.976720609s) [noise=true , address=64.49.13.140:4508 , piece_id=K7UHHOEM7KAV65RFOKAHAUG6XXOU6YA6BVCUIAUAYV54DHU3XYPA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:20.346523093 (57h52m30.069086133s) [noise=true , address=64.49.13.155:4923 , piece_id=3JXZLLI5YFD3NNWSY37KAX7HTQRB3GZZOPRAFRVXT676UKBGLVWA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:20.511095864 (57h52m30.233658904s) [noise=true , address=79.127.201.214:4317 , piece_id=CNCYGERXAVMLG3SCBV62ESHL27RUPJ43TQFVKL3ZCKYF7YNQPSMA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:20.832845494 (57h52m30.555408534s) [noise=true , address=79.127.205.235:4687 , piece_id=JBR4JE34VSDYMLE423TMAEGSN3BBDZ3YIKUSVXY7QZV4XOZETBGQ, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:21.000907721 (57h52m30.723470761s) [noise=true , address=79.127.201.215:4351 , piece_id=2HEWWASOEKRJTBFAOYLW5HYTHXGA7RR7AOKB5E4OKULT2XUWKJXQ, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:23.032964267 (57h52m32.755527307s) [noise=true , address=79.127.219.51:4201 , piece_id=OWW7RWZKDL5LZ4J36EWPROBWTAZOL3SIUPD7IM57G3T5NHURL2NA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:25.708428960 (57h52m35.430992s) [noise=true , address=77.90.31.13:4653 , piece_id=2XSRTZGYDGRSJOMMINHGWBABJRO4FND22VADVFMGMVTSQ4EON5SQ, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:28:25.731329757 (57h52m35.453892787s) [noise=true , address=77.90.31.15:4717 , piece_id=EBRL2LQLZBMKN3ZKBUMW32FOP3WYFRMSDZDGBVIERZDOYOPZHRQA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: <nil> Jul 26 21:29:17.460808661 (57h53m27.183371692s) [noise=true , address=104.36.82.42:4809 , piece_id=7MZWXYWGKXOUR23WBWIV6S36XYIGL2BMZBDVXZUYTHTPWSFGQ4JA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:1VZgucaa2gRuFhNxARMb7BDS6EGZXKChGPppbFksbPc5we7fTQ, address:104.36.82.42:4809): protocol: write tcp 188.166.225.170:55448->104.36.82.42:4809: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.460859820 (57h53m27.18342286s) [noise=true , address=104.36.82.14:4248 , piece_id=LU6G7ESP4XOXRA5MMISCEABTKMOKUAVKNM3HTTKUM5R3H3QP5ZWQ, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn, address:104.36.82.14:4248): protocol: rpc: dial tcp 104.36.82.14:4248: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.460898324 (57h53m27.183461364s) [noise=true , address=104.36.82.47:4538 , piece_id=QXFDEXKHWVRFQ3RMBOWDLXPUT333VBPZZS2BWTY6AQ7JLMSJ76IA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: rpc: dial tcp 104.36.82.47:4538: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.460931096 (57h53m27.183494136s) [noise=true , address=104.36.82.46:4515 , piece_id=LK5M7QLDLNT4IRK6S5JT4WON34AESKHRM5JTYRSVZ4FVC3LGW6RQ, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs, address:104.36.82.46:4515): protocol: write tcp 188.166.225.170:37156->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.460966564 (57h53m27.183529604s) [noise=true , address=104.36.82.54:4180 , piece_id=RDVRHQMV7JATSC3OFZIAIMJNBUBCTQOSA5XSJUY4DMRXOO2LEZ4A, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:1rhkcipPBZNFScBjBhWdigzSMwENSmzhCucnC2iuyc9udpweE3, address:104.36.82.54:4180): protocol: rpc: dial tcp 104.36.82.54:4180: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.461017461 (57h53m27.183580491s) [noise=true , address=104.36.82.52:4101 , piece_id=XAQGBFNDEURR5VILRF4N64TCWAHOXOTWNHPXZ3JEV3CXULY26KJA, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:12WWXeBjFZR9PzciNfs35fFcx87N9GwDpMsPHnksFDugtaBGWp4, address:104.36.82.52:4101): protocol: write tcp 188.166.225.170:52518->104.36.82.52:4101: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.461052939 (57h53m27.183615979s) [noise=true , address=104.36.82.56:4234 , piece_id=ZDOLTBHOBNGPBHE7FE2BVLPZMAVKVOZ6ELGBKJFZHMMK5DTX2HYQ, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy, address:104.36.82.56:4234): protocol: write tcp 188.166.225.170:37470->104.36.82.56:4234: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.461200682 (57h53m27.183763712s) [noise=true , address=104.36.82.5:4865 , piece_id=5HRGL4QISNOBRDSKXMKE3M4KMU4YIJVVZYGKT6QTRBOKHFQXZ4GQ, seg_pos={0 0}, upload=55554]: Done uploading piece. err: ecclient: upload failed (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL, address:104.36.82.5:4865): protocol: write tcp 188.166.225.170:33772->104.36.82.5:4865: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 21:29:17.461217744 (57h53m27.183780784s) [seg_pos={0 0}, upload=55554]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 26 21:29:17.701588522 (57h53m27.424151562s) [upload=55554]: Done uploading segments... Jul 26 21:29:17.701616585 (57h53m27.424179625s) [upload=55554]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.242649984s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.........X..........] duration: 1.851201782s FAIL (2025-07-26 21:28:43 UTC) orbiter warning: uplink: too many requests Duration: 1.85123695s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X......X.....................X.............................] duration: 7.527059039s FAIL (2025-07-26 21:27:58 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 7.527086462s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.........X.........] duration: 1.866983818s FAIL (2025-07-26 21:27:33 UTC) orbiter warning: uplink: too many requests Duration: 1.867008954s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X......X.....................X............................] duration: 6.142553442s FAIL (2025-07-26 21:27:27 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 6.142585574s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X......X.....................X...........................] duration: 6.103168264s FAIL (2025-07-26 21:26:35 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 6.103195186s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.........X........] duration: 1.910982342s FAIL (2025-07-26 21:26:34 UTC) orbiter warning: uplink: too many requests Duration: 1.911003573s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.........X.......] duration: 1.840252262s FAIL (2025-07-26 21:26:14 UTC) orbiter warning: uplink: too many requests Duration: 1.84028752s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X......X.....................X..........................] duration: 8.901320353s FAIL (2025-07-26 21:26:04 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 8.901338407s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X......X.....................X.........................] duration: 5.954612779s FAIL (2025-07-26 21:25:39 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 5.954640863s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.........X......] duration: 1.828563056s FAIL (2025-07-26 21:25:31 UTC) orbiter warning: uplink: too many requests Duration: 1.82860738s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.........X.....] duration: 1.991135129s FAIL (2025-07-26 21:24:50 UTC) orbiter warning: uplink: too many requests Duration: 1.991159867s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X......X.....................X........................] duration: 5.990514015s FAIL (2025-07-26 21:24:46 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 5.99056481s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X......X......X.....................X.......................] duration: 6.549991401s FAIL (2025-07-26 21:24:30 UTC) orbiter warning: digest mismatch: after 56c2e09ba15d0e699d08c0d58f3749f0fbc9398fb5fe0914f19c8c549edc5ebd != before dc381fcf7a830470aaaf14a12393caa67b6283bf63bfbc61c099113c1510e5f0 Duration: 6.550024203s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.........X....] duration: 1.893176703s FAIL (2025-07-26 21:24:22 UTC) orbiter warning: uplink: too many requests Duration: 1.893205639s core uplink us1 vivint

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)