Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.893965573s FAIL (2025-08-22 08:16:29 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.893990099s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....................X..............X.....X.X...............] duration: 1.986604895s FAIL (2025-08-22 08:16:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.986625614s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X................X............X........................X...X] duration: 4.978735442s FAIL (2025-08-22 08:16:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 08:16:08.652410840 (326h50m3.083490961s) [upload=340029]: Starting upload Aug 22 08:16:08.652458240 (326h50m3.083538361s) [upload=340029]: Done starting upload Aug 22 08:16:08.652560927 (326h50m3.083641058s) [upload=340029]: Uploading segments... Aug 22 08:16:08.652612315 (326h50m3.083692436s) [upload=340029]: Got next segment. Inline: false Aug 22 08:16:08.652651910 (326h50m3.083732042s) [upload=340029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:16:08.652656320 (326h50m3.083736451s) [upload=340029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:16:09.097674144 (326h50m3.528754265s) [seg_pos={0 0}, upload=340029]: Begin upload segment... Aug 22 08:16:09.097715674 (326h50m3.528795805s) [seg_pos={0 0}, upload=340029]: Done begin upload segment. Aug 22 08:16:09.097737516 (326h50m3.528817647s) [noise=true , address=77.90.31.13:4635 , piece_id=4MXEUDALGUQ5JIIDP47B5D7S6BUZVFRPGD7IQRDPMXYKJMJHR4PQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.098244054 (326h50m3.529324185s) [noise=true , address=77.90.31.21:4901 , piece_id=BAASQGNMCIPKINUVKCESF46AYDCANGEVUJKNDBXLBBSJWWIYVYLQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.098515293 (326h50m3.529595424s) [noise=true , address=104.36.82.12:4158 , piece_id=VV4ZZWDP4BSWOQGPQCUWNWNKYX6HSIGS6KZVOYH6EE5WC56HCAEQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.098818674 (326h50m3.529898805s) [noise=true , address=104.36.82.51:4071 , piece_id=OQUKKXEK64E562MM6LFEDSVUBS6JJYOBDDRONZGVWGUZS3T73MOA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.099082448 (326h50m3.530162569s) [noise=true , address=77.90.31.17:4782 , piece_id=VEBV4Q65FQWRGDCAXVHQBJF4DHFYEJFQYGJ6XIM6R3E33QBCB6WA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.099350501 (326h50m3.530430622s) [noise=true , address=79.127.219.48:4099 , piece_id=7CY5UYCUQ2ZCBEEFB4AW7OXDWDX4ZC5W7KUCHO7R76GDHLIBXHCA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.099682707 (326h50m3.530762838s) [noise=true , address=45.91.116.4:4948 , piece_id=QVNAAMPWMTHL2ZPJRUF2SK5EXOF27GDZLPJYGT6E7YAHNXBEOUAA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.103865751 (326h50m3.534945882s) [noise=true , address=79.127.220.97:4379 , piece_id=7SSLQBJR7WQ4FNW4HSY4IA2IWLZCPONNRC7J66TFYCRIDDWEJBKQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.108184955 (326h50m3.539265076s) [noise=true , address=104.36.82.49:4998 , piece_id=TIYF677DVGULZPY4HNH4VDBHMKRGLEDKSGTEMMQTGU2ZZ3NJYSLQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.108512001 (326h50m3.539592142s) [noise=true , address=77.90.31.16:4767 , piece_id=WBAKFNMYJL4NOO2RPALQBDMFRHS5KHNAIJFXL2RQRCATPHCHX7DQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.108754404 (326h50m3.539834556s) [noise=true , address=79.127.205.245:4237 , piece_id=D6LIDE5PC3CD7YVRMWUTDEEZI5KAHJWW2ZV54MDXKXW3YUGKJ6CA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.109770879 (326h50m3.54085101s) [noise=true , address=45.91.116.12:4229 , piece_id=7V2YLJQD6DVX6THV7UA2S4SOOFVLXQAFKVN4YAO6YG4ZNCYDLJ2Q, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.118843007 (326h50m3.549923168s) [noise=true , address=77.90.31.11:4562 , piece_id=X4EU2UKBMKMNELHQWUW5WR3AYFNY5MW7FFUVVQZKIFFQQXDZ7CEQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.119289121 (326h50m3.550369252s) [noise=true , address=77.90.31.10:4546 , piece_id=4J5MOGBIKV4LYZW55UHCBJGJQJG34AFLHVUVSNAVBX7S7CLAH5MQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.119800970 (326h50m3.550881101s) [noise=true , address=79.127.219.51:4207 , piece_id=AKFUZ7MAPASNA3NSVENDVPAJWUAODSU6WNJAKFIY5ZSUGVEJI6DA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.120491632 (326h50m3.551571764s) [noise=true , address=79.127.201.215:4347 , piece_id=42LYDABBTYZ4CQT4BUO7T5R7MBLTYWPW2AC2FC4IHXHL4YMCB5XA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.121283366 (326h50m3.552363508s) [noise=true , address=45.91.116.10:4106 , piece_id=5ZAUO32WXOBLPN2XU7LFFRWHAWTUXAVKEVGAO24X2PASFHCZ5MQA, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:09.122053120 (326h50m3.553133251s) [noise=true , address=104.36.82.23:4473 , piece_id=6IBQTVS3FMT6NMQNDISBAFILBT35M2GWU5J3JEFGOWHQAAMSMKTQ, seg_pos={0 0}, upload=340029]: Uploading piece... Aug 22 08:16:10.240673957 (326h50m4.671754138s) [upload=340029]: Next returned nil segment Aug 22 08:16:10.240698503 (326h50m4.671778634s) [upload=340029]: Waiting for error group managing segments... Aug 22 08:16:10.522752718 (326h50m4.953832839s) [noise=true , address=79.127.205.245:4237 , piece_id=D6LIDE5PC3CD7YVRMWUTDEEZI5KAHJWW2ZV54MDXKXW3YUGKJ6CA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:10.957781950 (326h50m5.388862081s) [noise=true , address=79.127.220.97:4379 , piece_id=7SSLQBJR7WQ4FNW4HSY4IA2IWLZCPONNRC7J66TFYCRIDDWEJBKQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:10.990205328 (326h50m5.421285459s) [noise=true , address=79.127.219.48:4099 , piece_id=7CY5UYCUQ2ZCBEEFB4AW7OXDWDX4ZC5W7KUCHO7R76GDHLIBXHCA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:10.995525648 (326h50m5.426605769s) [noise=true , address=77.90.31.13:4635 , piece_id=4MXEUDALGUQ5JIIDP47B5D7S6BUZVFRPGD7IQRDPMXYKJMJHR4PQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.012732341 (326h50m5.443812472s) [noise=true , address=45.91.116.12:4229 , piece_id=7V2YLJQD6DVX6THV7UA2S4SOOFVLXQAFKVN4YAO6YG4ZNCYDLJ2Q, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.020771774 (326h50m5.451851905s) [noise=true , address=45.91.116.10:4106 , piece_id=5ZAUO32WXOBLPN2XU7LFFRWHAWTUXAVKEVGAO24X2PASFHCZ5MQA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.035439197 (326h50m5.466519328s) [noise=true , address=77.90.31.10:4546 , piece_id=4J5MOGBIKV4LYZW55UHCBJGJQJG34AFLHVUVSNAVBX7S7CLAH5MQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.088518248 (326h50m5.519598379s) [noise=true , address=79.127.219.51:4207 , piece_id=AKFUZ7MAPASNA3NSVENDVPAJWUAODSU6WNJAKFIY5ZSUGVEJI6DA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.090664755 (326h50m5.521744886s) [noise=true , address=77.90.31.21:4901 , piece_id=BAASQGNMCIPKINUVKCESF46AYDCANGEVUJKNDBXLBBSJWWIYVYLQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.111894716 (326h50m5.542974847s) [noise=true , address=79.127.201.215:4347 , piece_id=42LYDABBTYZ4CQT4BUO7T5R7MBLTYWPW2AC2FC4IHXHL4YMCB5XA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.113291078 (326h50m5.544371209s) [noise=true , address=104.36.82.12:4158 , piece_id=VV4ZZWDP4BSWOQGPQCUWNWNKYX6HSIGS6KZVOYH6EE5WC56HCAEQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.130181335 (326h50m5.561261466s) [noise=true , address=104.36.82.23:4473 , piece_id=6IBQTVS3FMT6NMQNDISBAFILBT35M2GWU5J3JEFGOWHQAAMSMKTQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.133918385 (326h50m5.564998516s) [noise=true , address=77.90.31.17:4782 , piece_id=VEBV4Q65FQWRGDCAXVHQBJF4DHFYEJFQYGJ6XIM6R3E33QBCB6WA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.134059996 (326h50m5.565140127s) [noise=true , address=77.90.31.16:4767 , piece_id=WBAKFNMYJL4NOO2RPALQBDMFRHS5KHNAIJFXL2RQRCATPHCHX7DQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: <nil> Aug 22 08:16:11.134095104 (326h50m5.565175225s) [seg_pos={0 0}, upload=340029]: Segment reached optimal threshold of 14 pieces. Aug 22 08:16:11.134221024 (326h50m5.565301155s) [noise=true , address=45.91.116.4:4948 , piece_id=QVNAAMPWMTHL2ZPJRUF2SK5EXOF27GDZLPJYGT6E7YAHNXBEOUAA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:184g6qHdezLW3d2CKNW8GRgdzeVLQuMEhd8B8c1zEnkKNkeSTu): protocol: expected piece hash; context canceled; EOF Aug 22 08:16:11.134297971 (326h50m5.565378102s) [noise=true , address=77.90.31.11:4562 , piece_id=X4EU2UKBMKMNELHQWUW5WR3AYFNY5MW7FFUVVQZKIFFQQXDZ7CEQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SXQ4wGnLgKifp7pWWtKGtCom5K7fGceJHy2SyLGvUemZx4H4r): protocol: expected piece hash; context canceled; EOF Aug 22 08:16:11.134312318 (326h50m5.565392449s) [noise=true , address=104.36.82.51:4071 , piece_id=OQUKKXEK64E562MM6LFEDSVUBS6JJYOBDDRONZGVWGUZS3T73MOA, seg_pos={0 0}, upload=340029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VqztUNDN3hhJAMvCJtPreW7BdtAWSofQxAtmDKfDiX5sNEfWY): protocol: expected piece hash; context canceled; EOF Aug 22 08:16:11.134358657 (326h50m5.565438778s) [noise=true , address=104.36.82.49:4998 , piece_id=TIYF677DVGULZPY4HNH4VDBHMKRGLEDKSGTEMMQTGU2ZZ3NJYSLQ, seg_pos={0 0}, upload=340029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LV3A9EyGYTRvni2ENn6yYkBdxQiJFW6zLC9vikrezvz6F9dEX): protocol: expected piece hash; context canceled; EOF Aug 22 08:16:11.134380149 (326h50m5.56546029s) [seg_pos={0 0}, upload=340029]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:16:11.134459511 (326h50m5.565539652s) [upload=340029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:16:11.134464590 (326h50m5.565544721s) [upload=340029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:16:12.229250845 (326h50m6.660330976s) [upload=340029]: Done uploading segments... Aug 22 08:16:12.229268679 (326h50m6.66034881s) [upload=340029]: Upload finished. err: <nil> Duration: 4.978765058s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.914269565s FAIL (2025-08-22 08:16:09 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.914435293s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................X..............X.....X.X..............] duration: 1.826810057s FAIL (2025-08-22 08:16:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.826836016s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......................X..............X.....X.X.............] duration: 2.223818009s FAIL (2025-08-22 08:15:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.223842886s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.808465512s FAIL (2025-08-22 08:15:11 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.808499477s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X................X............X........................X...] duration: 6.056075151s FAIL (2025-08-22 08:15:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 08:13:06.490459376 (326h47m0.921539507s) [upload=339976]: Starting upload Aug 22 08:13:06.490505994 (326h47m0.921586125s) [upload=339976]: Done starting upload Aug 22 08:13:06.490569947 (326h47m0.921650068s) [upload=339976]: Uploading segments... Aug 22 08:13:06.490671300 (326h47m0.921751421s) [upload=339976]: Got next segment. Inline: false Aug 22 08:13:06.490694876 (326h47m0.921775007s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:13:06.490698653 (326h47m0.921778774s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:13:06.949181732 (326h47m1.380261863s) [seg_pos={0 0}, upload=339976]: Begin upload segment... Aug 22 08:13:06.949225556 (326h47m1.380305687s) [seg_pos={0 0}, upload=339976]: Done begin upload segment. Aug 22 08:13:06.949245854 (326h47m1.380325975s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949257106 (326h47m1.380337237s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949286432 (326h47m1.380366563s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949349322 (326h47m1.380429453s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949602567 (326h47m1.380682698s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949618337 (326h47m1.380698458s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949880449 (326h47m1.38096057s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949896209 (326h47m1.38097634s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950137220 (326h47m1.381217351s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950151829 (326h47m1.38123196s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950360377 (326h47m1.381440508s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950369494 (326h47m1.381449625s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950579156 (326h47m1.381659287s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950584706 (326h47m1.381664837s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950799347 (326h47m1.381879478s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951023997 (326h47m1.382104118s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951242354 (326h47m1.382322476s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951428711 (326h47m1.382508832s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:08.430852089 (326h47m2.86193222s) [upload=339976]: Next returned nil segment Aug 22 08:13:08.430868711 (326h47m2.861948842s) [upload=339976]: Waiting for error group managing segments... Aug 22 08:13:08.809883988 (326h47m3.240964109s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.838720924 (326h47m3.269801055s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.841495863 (326h47m3.272575994s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.842370547 (326h47m3.273450678s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.843812045 (326h47m3.274892176s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.853989648 (326h47m3.285069779s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.855980358 (326h47m3.287060489s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.858381451 (326h47m3.289461582s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.869942543 (326h47m3.301022674s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.901270815 (326h47m3.332350936s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.909960912 (326h47m3.341041043s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.921616885 (326h47m3.352697016s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.948784336 (326h47m3.379864467s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957124233 (326h47m3.388204354s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957143931 (326h47m3.388224052s) [seg_pos={0 0}, upload=339976]: Segment reached optimal threshold of 14 pieces. Aug 22 08:13:08.957252889 (326h47m3.38833302s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rBZH6aLHsnWh22uNzaMiMwmLJCDMn4bYbNC5jRG7KCEuRfqpH): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958112243 (326h47m3.389192374s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958193559 (326h47m3.38927368s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1idhhqhMLNNdqYUVgARJhhuTjF4kcxPUc9e3ymVMYZDiWGAxwm): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958248354 (326h47m3.389328485s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958260457 (326h47m3.389340578s) [seg_pos={0 0}, upload=339976]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:13:08.958327625 (326h47m3.389407756s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:13:08.958331893 (326h47m3.389412024s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:13:09.270244990 (326h47m3.701325121s) [upload=339976]: Done uploading segments... Aug 22 08:13:09.270250891 (326h47m3.701331022s) [upload=339976]: Upload finished. err: <nil> Duration: 6.056123573s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........................X..............X.....X.X............] duration: 2.11383976s FAIL (2025-08-22 08:14:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.113895016s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.793865872s FAIL (2025-08-22 08:14:37 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.793890719s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.X................X............X........................X..] duration: 5.662227157s FAIL (2025-08-22 08:14:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 08:13:06.490459376 (326h47m0.921539507s) [upload=339976]: Starting upload Aug 22 08:13:06.490505994 (326h47m0.921586125s) [upload=339976]: Done starting upload Aug 22 08:13:06.490569947 (326h47m0.921650068s) [upload=339976]: Uploading segments... Aug 22 08:13:06.490671300 (326h47m0.921751421s) [upload=339976]: Got next segment. Inline: false Aug 22 08:13:06.490694876 (326h47m0.921775007s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:13:06.490698653 (326h47m0.921778774s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:13:06.949181732 (326h47m1.380261863s) [seg_pos={0 0}, upload=339976]: Begin upload segment... Aug 22 08:13:06.949225556 (326h47m1.380305687s) [seg_pos={0 0}, upload=339976]: Done begin upload segment. Aug 22 08:13:06.949245854 (326h47m1.380325975s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949257106 (326h47m1.380337237s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949286432 (326h47m1.380366563s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949349322 (326h47m1.380429453s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949602567 (326h47m1.380682698s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949618337 (326h47m1.380698458s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949880449 (326h47m1.38096057s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949896209 (326h47m1.38097634s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950137220 (326h47m1.381217351s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950151829 (326h47m1.38123196s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950360377 (326h47m1.381440508s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950369494 (326h47m1.381449625s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950579156 (326h47m1.381659287s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950584706 (326h47m1.381664837s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950799347 (326h47m1.381879478s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951023997 (326h47m1.382104118s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951242354 (326h47m1.382322476s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951428711 (326h47m1.382508832s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:08.430852089 (326h47m2.86193222s) [upload=339976]: Next returned nil segment Aug 22 08:13:08.430868711 (326h47m2.861948842s) [upload=339976]: Waiting for error group managing segments... Aug 22 08:13:08.809883988 (326h47m3.240964109s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.838720924 (326h47m3.269801055s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.841495863 (326h47m3.272575994s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.842370547 (326h47m3.273450678s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.843812045 (326h47m3.274892176s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.853989648 (326h47m3.285069779s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.855980358 (326h47m3.287060489s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.858381451 (326h47m3.289461582s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.869942543 (326h47m3.301022674s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.901270815 (326h47m3.332350936s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.909960912 (326h47m3.341041043s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.921616885 (326h47m3.352697016s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.948784336 (326h47m3.379864467s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957124233 (326h47m3.388204354s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957143931 (326h47m3.388224052s) [seg_pos={0 0}, upload=339976]: Segment reached optimal threshold of 14 pieces. Aug 22 08:13:08.957252889 (326h47m3.38833302s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rBZH6aLHsnWh22uNzaMiMwmLJCDMn4bYbNC5jRG7KCEuRfqpH): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958112243 (326h47m3.389192374s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958193559 (326h47m3.38927368s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1idhhqhMLNNdqYUVgARJhhuTjF4kcxPUc9e3ymVMYZDiWGAxwm): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958248354 (326h47m3.389328485s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958260457 (326h47m3.389340578s) [seg_pos={0 0}, upload=339976]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:13:08.958327625 (326h47m3.389407756s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:13:08.958331893 (326h47m3.389412024s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:13:09.270244990 (326h47m3.701325121s) [upload=339976]: Done uploading segments... Aug 22 08:13:09.270250891 (326h47m3.701331022s) [upload=339976]: Upload finished. err: <nil> Duration: 5.66225559s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.807584396s FAIL (2025-08-22 08:14:12 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.80762813s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.X................X............X........................X.] duration: 5.455010194s FAIL (2025-08-22 08:14:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 08:13:06.490459376 (326h47m0.921539507s) [upload=339976]: Starting upload Aug 22 08:13:06.490505994 (326h47m0.921586125s) [upload=339976]: Done starting upload Aug 22 08:13:06.490569947 (326h47m0.921650068s) [upload=339976]: Uploading segments... Aug 22 08:13:06.490671300 (326h47m0.921751421s) [upload=339976]: Got next segment. Inline: false Aug 22 08:13:06.490694876 (326h47m0.921775007s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:13:06.490698653 (326h47m0.921778774s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:13:06.949181732 (326h47m1.380261863s) [seg_pos={0 0}, upload=339976]: Begin upload segment... Aug 22 08:13:06.949225556 (326h47m1.380305687s) [seg_pos={0 0}, upload=339976]: Done begin upload segment. Aug 22 08:13:06.949245854 (326h47m1.380325975s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949257106 (326h47m1.380337237s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949286432 (326h47m1.380366563s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949349322 (326h47m1.380429453s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949602567 (326h47m1.380682698s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949618337 (326h47m1.380698458s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949880449 (326h47m1.38096057s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949896209 (326h47m1.38097634s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950137220 (326h47m1.381217351s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950151829 (326h47m1.38123196s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950360377 (326h47m1.381440508s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950369494 (326h47m1.381449625s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950579156 (326h47m1.381659287s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950584706 (326h47m1.381664837s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950799347 (326h47m1.381879478s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951023997 (326h47m1.382104118s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951242354 (326h47m1.382322476s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951428711 (326h47m1.382508832s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:08.430852089 (326h47m2.86193222s) [upload=339976]: Next returned nil segment Aug 22 08:13:08.430868711 (326h47m2.861948842s) [upload=339976]: Waiting for error group managing segments... Aug 22 08:13:08.809883988 (326h47m3.240964109s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.838720924 (326h47m3.269801055s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.841495863 (326h47m3.272575994s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.842370547 (326h47m3.273450678s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.843812045 (326h47m3.274892176s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.853989648 (326h47m3.285069779s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.855980358 (326h47m3.287060489s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.858381451 (326h47m3.289461582s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.869942543 (326h47m3.301022674s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.901270815 (326h47m3.332350936s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.909960912 (326h47m3.341041043s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.921616885 (326h47m3.352697016s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.948784336 (326h47m3.379864467s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957124233 (326h47m3.388204354s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957143931 (326h47m3.388224052s) [seg_pos={0 0}, upload=339976]: Segment reached optimal threshold of 14 pieces. Aug 22 08:13:08.957252889 (326h47m3.38833302s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rBZH6aLHsnWh22uNzaMiMwmLJCDMn4bYbNC5jRG7KCEuRfqpH): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958112243 (326h47m3.389192374s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958193559 (326h47m3.38927368s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1idhhqhMLNNdqYUVgARJhhuTjF4kcxPUc9e3ymVMYZDiWGAxwm): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958248354 (326h47m3.389328485s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958260457 (326h47m3.389340578s) [seg_pos={0 0}, upload=339976]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:13:08.958327625 (326h47m3.389407756s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:13:08.958331893 (326h47m3.389412024s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:13:09.270244990 (326h47m3.701325121s) [upload=339976]: Done uploading segments... Aug 22 08:13:09.270250891 (326h47m3.701331022s) [upload=339976]: Upload finished. err: <nil> Duration: 5.455035681s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........................X..............X.....X.X...........] duration: 2.074482978s FAIL (2025-08-22 08:14:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.074562331s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.872783875s FAIL (2025-08-22 08:13:30 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.872811308s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........................X..............X.....X.X..........] duration: 2.181302193s FAIL (2025-08-22 08:13:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.181326619s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.X................X............X........................X] duration: 4.103029601s FAIL (2025-08-22 08:13:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 08:13:06.490459376 (326h47m0.921539507s) [upload=339976]: Starting upload Aug 22 08:13:06.490505994 (326h47m0.921586125s) [upload=339976]: Done starting upload Aug 22 08:13:06.490569947 (326h47m0.921650068s) [upload=339976]: Uploading segments... Aug 22 08:13:06.490671300 (326h47m0.921751421s) [upload=339976]: Got next segment. Inline: false Aug 22 08:13:06.490694876 (326h47m0.921775007s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:13:06.490698653 (326h47m0.921778774s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:13:06.949181732 (326h47m1.380261863s) [seg_pos={0 0}, upload=339976]: Begin upload segment... Aug 22 08:13:06.949225556 (326h47m1.380305687s) [seg_pos={0 0}, upload=339976]: Done begin upload segment. Aug 22 08:13:06.949245854 (326h47m1.380325975s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949257106 (326h47m1.380337237s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949286432 (326h47m1.380366563s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949349322 (326h47m1.380429453s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949602567 (326h47m1.380682698s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949618337 (326h47m1.380698458s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949880449 (326h47m1.38096057s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.949896209 (326h47m1.38097634s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950137220 (326h47m1.381217351s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950151829 (326h47m1.38123196s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950360377 (326h47m1.381440508s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950369494 (326h47m1.381449625s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950579156 (326h47m1.381659287s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950584706 (326h47m1.381664837s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.950799347 (326h47m1.381879478s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951023997 (326h47m1.382104118s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951242354 (326h47m1.382322476s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:06.951428711 (326h47m1.382508832s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Uploading piece... Aug 22 08:13:08.430852089 (326h47m2.86193222s) [upload=339976]: Next returned nil segment Aug 22 08:13:08.430868711 (326h47m2.861948842s) [upload=339976]: Waiting for error group managing segments... Aug 22 08:13:08.809883988 (326h47m3.240964109s) [noise=true , address=79.127.219.48:4107 , piece_id=IQ4DV6ODI7C2N4MXCN56UU6BDTML4OR4GIMZ5TO6ALKQ6XVPBUBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.838720924 (326h47m3.269801055s) [noise=true , address=45.91.116.14:4202 , piece_id=TDQYWC23BICMYWSI7JK4MCOQYKNZUOQJJ4AABVDQWYDXKUCYYC3Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.841495863 (326h47m3.272575994s) [noise=true , address=45.91.116.13:4180 , piece_id=F5UVZKSJPPKOXLTG2GTQ4DHS2LBSBLVLM7XZSHQD73GA4BB3UHMA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.842370547 (326h47m3.273450678s) [noise=true , address=45.91.116.12:4252 , piece_id=ONDA7YDAXI7CONIJICYAQEGX7KJPARXERMJLHOZL53F5L2AZMD7Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.843812045 (326h47m3.274892176s) [noise=true , address=77.90.31.21:4901 , piece_id=TWNSYWHG7ACWCPXQDW2FDPRBWSHFDFSBLUBKQVXDMXCQKNXCTPEA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.853989648 (326h47m3.285069779s) [noise=true , address=77.90.31.19:4850 , piece_id=YGVGUQMMWC3F2DKFCTC7HQZJ6O44QVUCJ4LAXWJKJXP7LZZ6ZTEQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.855980358 (326h47m3.287060489s) [noise=true , address=77.90.31.16:4762 , piece_id=W7NYSUDQKQI5GUVWV7526T727DQSYI7QBZWET65ZSFHRYLTETE6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.858381451 (326h47m3.289461582s) [noise=true , address=104.36.82.9:4008 , piece_id=COV5R2V6FTBL4EPH7F4I7UEFPO6YLBFJ6PG72Q3AQO3ZUMGPTWZQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.869942543 (326h47m3.301022674s) [noise=true , address=79.127.201.215:4337 , piece_id=5HQ6R5FJCDI2RRSO2TFY7RMVFLS3JNF374T3FK47YBDUHMAB54CQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.901270815 (326h47m3.332350936s) [noise=true , address=77.90.31.11:4560 , piece_id=YBYQAF35CY25ADBLLRBNOI6PWIYEQGVWP33PI4LEBVLGHYDWABQA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.909960912 (326h47m3.341041043s) [noise=true , address=77.90.31.18:4823 , piece_id=VARJEFZYP3UHALATBYU63BFAZD3JGPED4V6ZQMBK45OYRJWLQ2XQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.921616885 (326h47m3.352697016s) [noise=true , address=104.36.82.60:4364 , piece_id=7VOT63BHUK7XA46DSTBFFPPFNUUDCDCTLRTQWEHKPLLTDE2TPL5Q, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.948784336 (326h47m3.379864467s) [noise=true , address=104.36.82.23:4470 , piece_id=HKBIWORLB46IMDZPTW6J3ZUTOSU3YVRBC5IIBMN533NOV5SQGW6A, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957124233 (326h47m3.388204354s) [noise=true , address=45.91.116.10:4112 , piece_id=IPW5EPSJ6EWURQGJLSWOKXX5JVP42GFRWT2UIGA5KWTGBNIQYXBQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: <nil> Aug 22 08:13:08.957143931 (326h47m3.388224052s) [seg_pos={0 0}, upload=339976]: Segment reached optimal threshold of 14 pieces. Aug 22 08:13:08.957252889 (326h47m3.38833302s) [noise=true , address=104.36.82.55:4204 , piece_id=VYPVDVKFVV3EOHUW66E7GZ74YWB4LIENGO423INAMUU4W4XMU7DA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rBZH6aLHsnWh22uNzaMiMwmLJCDMn4bYbNC5jRG7KCEuRfqpH): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958112243 (326h47m3.389192374s) [noise=true , address=77.90.31.10:4531 , piece_id=MCXBKEDS4Z4ZOU53K3CXZNESHOMXMZ6BDHOSSGYFKQW2JBAMR3JA, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958193559 (326h47m3.38927368s) [noise=true , address=104.36.82.18:4387 , piece_id=4PDEI6K5DD2QB2HWF5T4BJHPCUU2WJCJAU2ZY6SI4VB77NHMXUFQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1idhhqhMLNNdqYUVgARJhhuTjF4kcxPUc9e3ymVMYZDiWGAxwm): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958248354 (326h47m3.389328485s) [noise=true , address=104.36.82.5:4867 , piece_id=3SRBTWK7RQPWOCI6IJRVPE7VG3V7DCKHCHLZDS2FDLPYLRBGGGJQ, seg_pos={0 0}, upload=339976]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: expected piece hash; context canceled; EOF Aug 22 08:13:08.958260457 (326h47m3.389340578s) [seg_pos={0 0}, upload=339976]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:13:08.958327625 (326h47m3.389407756s) [upload=339976]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:13:08.958331893 (326h47m3.389412024s) [upload=339976]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:13:09.270244990 (326h47m3.701325121s) [upload=339976]: Done uploading segments... Aug 22 08:13:09.270250891 (326h47m3.701331022s) [upload=339976]: Upload finished. err: <nil> Duration: 4.103053407s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.X................X............X........................] duration: 6.049209722s FAIL (2025-08-22 08:12:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 6.049251492s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.X................X............X.......................] duration: 6.058663838s FAIL (2025-08-22 08:12:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 6.058707361s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.126339713s FAIL (2025-08-22 08:12:20 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.126365451s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X..........................X..............X.....X.X.........] duration: 1.872628354s FAIL (2025-08-22 08:12:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.872656377s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 4.92451243s FAIL (2025-08-22 08:11:58 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.924536155s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.X................X............X......................] duration: 5.837165098s FAIL (2025-08-22 08:11:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.837190706s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X..........................X..............X.....X.X........] duration: 2.337765865s FAIL (2025-08-22 08:11:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.337791986s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.X................X............X.....................] duration: 5.899026856s FAIL (2025-08-22 08:11:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.899052434s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X..........................X..............X.....X.X.......] duration: 1.916724828s FAIL (2025-08-22 08:11:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.916752109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.842058996s FAIL (2025-08-22 08:10:50 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.842079064s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.X................X............X....................] duration: 5.935726822s FAIL (2025-08-22 08:10:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.935745588s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.887319208s FAIL (2025-08-22 08:10:15 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.887344707s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X..........................X..............X.....X.X......] duration: 1.909424007s FAIL (2025-08-22 08:10:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.909450248s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.X................X............X...................] duration: 5.902453929s FAIL (2025-08-22 08:09:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.902481981s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 4.947211475s FAIL (2025-08-22 08:09:57 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.947239s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X..........................X..............X.....X.X.....] duration: 2.015114559s FAIL (2025-08-22 08:09:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.015133195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.887938229s FAIL (2025-08-22 08:09:32 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.887972556s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....X..........................X..............X.....X.X....] duration: 2.15129322s FAIL (2025-08-22 08:09:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.151318409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.X................X............X..................] duration: 5.963238563s FAIL (2025-08-22 08:08:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.963261637s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.150050759s FAIL (2025-08-22 08:08:36 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.150069885s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......X..........................X..............X.....X.X...] duration: 1.889519582s FAIL (2025-08-22 08:08:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.889555993s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.192621425s FAIL (2025-08-22 08:08:18 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.192667322s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.X................X............X.................] duration: 5.867062762s FAIL (2025-08-22 08:07:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.867095214s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......X..........................X..............X.....X.X..] duration: 1.85786167s FAIL (2025-08-22 08:07:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.857896938s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.891706436s FAIL (2025-08-22 08:07:21 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.891738989s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.X................X............X................] duration: 6.372716527s FAIL (2025-08-22 08:07:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 6.372738519s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X..........................X..............X.....X.X.] duration: 1.90866153s FAIL (2025-08-22 08:06:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.908686638s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.X................X............X...............] duration: 5.989787559s FAIL (2025-08-22 08:06:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.989820251s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 4.848461808s FAIL (2025-08-22 08:06:19 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.848488359s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X..........................X..............X.....X.X] duration: 855.85059ms FAIL (2025-08-22 08:06:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:06:14.685390166 (326h40m9.116470347s) [upload=339855]: Starting upload Aug 22 08:06:14.685509695 (326h40m9.116589866s) [upload=339855]: Done starting upload Aug 22 08:06:14.685603675 (326h40m9.116683806s) [upload=339855]: Uploading segments... Aug 22 08:06:14.685707513 (326h40m9.116787645s) [upload=339855]: Got next segment. Inline: true Aug 22 08:06:14.685712403 (326h40m9.116792534s) [upload=339855]: Waiting for error group managing segments... Aug 22 08:06:14.685837082 (326h40m9.116917213s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:06:14.685842782 (326h40m9.116922903s) [upload=339855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:06:14.685853242 (326h40m9.116933373s) [upload=339855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:06:14.898733191 (326h40m9.329813322s) [upload=339855]: Done uploading segments... Aug 22 08:06:14.898745143 (326h40m9.329825275s) [upload=339855]: Upload finished. err: metaclient: Too Many Requests Duration:* 855.884235ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X..........................X..............X.....X.] duration: 1.975864764s FAIL (2025-08-22 08:05:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 22 08:05:04.020092819 (326h38m58.45117295s) [upload=339836]: Starting upload Aug 22 08:05:04.020176709 (326h38m58.45125684s) [upload=339836]: Done starting upload Aug 22 08:05:04.020281049 (326h38m58.45136118s) [upload=339836]: Uploading segments... Aug 22 08:05:04.020349660 (326h38m58.451429811s) [upload=339836]: Got next segment. Inline: true Aug 22 08:05:04.020357785 (326h38m58.451437926s) [upload=339836]: Waiting for error group managing segments... Aug 22 08:05:04.020434953 (326h38m58.451515084s) [upload=339836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:05:04.020441886 (326h38m58.451522017s) [upload=339836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:05:04.020445253 (326h38m58.451525384s) [upload=339836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:05:05.117953536 (326h38m59.549033667s) [upload=339836]: Done uploading segments... Aug 22 08:05:05.117972671 (326h38m59.549052802s) [upload=339836]: Upload finished. err: <nil> Duration:* 1.975900482s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.32230364s FAIL (2025-08-22 08:05:39 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.322328879s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.X................X............X..............] duration: 5.985132313s FAIL (2025-08-22 08:05:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d3faaa6209e675f93c4d27fa320fde96152b312b6317410ac0db90aca035caf7 != before 0f7e5784cfee01739a3b2fee9463ebaa0eb8051880b457a560aa82787515203e ======LOGS====== Aug 22 07:55:49.720647518 (326h29m44.151727639s) [upload=339674]: Starting upload Aug 22 07:55:49.720697744 (326h29m44.151777875s) [upload=339674]: Done starting upload Aug 22 07:55:49.720779801 (326h29m44.151859922s) [upload=339674]: Uploading segments... Aug 22 07:55:49.721035310 (326h29m44.152115431s) [upload=339674]: Got next segment. Inline: false Aug 22 07:55:49.721074365 (326h29m44.152154496s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 07:55:49.721081970 (326h29m44.152162101s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 07:55:50.181201872 (326h29m44.612282003s) [seg_pos={0 0}, upload=339674]: Begin upload segment... Aug 22 07:55:50.181253280 (326h29m44.612333411s) [seg_pos={0 0}, upload=339674]: Done begin upload segment. Aug 22 07:55:50.181276024 (326h29m44.612356145s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181314537 (326h29m44.612394658s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181647424 (326h29m44.612727555s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181748658 (326h29m44.612828789s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.181946947 (326h29m44.613027078s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182054503 (326h29m44.613134634s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182223587 (326h29m44.613303718s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182502350 (326h29m44.613582481s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.182772557 (326h29m44.613852688s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183052924 (326h29m44.614133055s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183263276 (326h29m44.614343407s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183465243 (326h29m44.614545374s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183692878 (326h29m44.614773009s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.183894203 (326h29m44.614974334s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184125015 (326h29m44.615205146s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184439988 (326h29m44.615520119s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184683774 (326h29m44.615763905s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:50.184883216 (326h29m44.615963347s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Uploading piece... Aug 22 07:55:51.302002456 (326h29m45.733082587s) [upload=339674]: Next returned nil segment Aug 22 07:55:51.302018057 (326h29m45.733098188s) [upload=339674]: Waiting for error group managing segments... Aug 22 07:55:51.585860953 (326h29m46.016941084s) [noise=true , address=79.127.205.245:4247 , piece_id=AXYVFW66F45CSXQN6UWTCCQ3TIKFDKI4GOSQBQGGKAM42UUC4XBA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.074699817 (326h29m46.505779948s) [noise=true , address=77.90.31.17:4780 , piece_id=TTXBXCIERFYTR535MGCWB22DCQZ4F7BJBQDQEFV352XEWKOH3I2A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.075329191 (326h29m46.506409322s) [noise=true , address=45.91.116.8:4058 , piece_id=VVTYWJGYUZ5VWFIGUR5YU23IZT26NSJYJWQZO3JEQ76ZBFSVQ4UA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.080778368 (326h29m46.511858499s) [noise=true , address=45.91.116.13:4183 , piece_id=KYX46RHSUNI6SLJYQZSIQW5QJUQZS43O4ILTCOQHPWPG3XIIN7HQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.083140549 (326h29m46.51422068s) [noise=true , address=77.90.31.16:4738 , piece_id=7IH3YZ3NMFIZKUYBDOZZT7BHWG3GXJS7ILKI57PMPNR77N5CWPJA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089260458 (326h29m46.520340589s) [noise=true , address=77.90.31.19:4847 , piece_id=EICQ2NOTAPJ3OEY5ITDZFSCN2A5W4AHPMQ7AT2J6VNZAHRESDAOQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.089578526 (326h29m46.520658657s) [noise=true , address=77.90.31.18:4833 , piece_id=DE37TAFL6AOUJRLEK3ZCPXMHHZCIDMQTPZM2SIV6AGXTMJHNCL3Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.102336598 (326h29m46.533416729s) [noise=true , address=104.36.82.23:4460 , piece_id=FJFXLWOI2PZ5YCEFVDCO53LVGS2PB32QTWITWSEYBBUKPJYIVLUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.103291516 (326h29m46.534371637s) [noise=true , address=77.90.31.10:4551 , piece_id=M65FHTURPUOKFTLO26UY4AQQST67WSSMLF55RJAFPJTXDVYPP4DA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.108459094 (326h29m46.539539225s) [noise=true , address=104.36.82.18:4381 , piece_id=EEA7R47AFCKUMVQBZNXMWRRUTJBKUYXWZCICN7NH2F7MABBJI2QA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.110360482 (326h29m46.541440603s) [noise=true , address=104.36.82.11:4138 , piece_id=VXB4RCJXUSDO6CMEMBCPMA4HXFAW2RXXKP4JFLEO7CEBVILBMXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.123565329 (326h29m46.55464546s) [noise=true , address=104.36.82.5:4851 , piece_id=R2U7KVPPDRPDOUFKVDMOGIU4BQPE5L3J3DFS57WIHRQISM3AYXNQ, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.165790554 (326h29m46.596870685s) [noise=true , address=77.90.31.11:4568 , piece_id=CKQSQ4S27YYXOZY6PEJO3WY2WCFK3TBXFJ5PI577KNDTBYKC7V7Q, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202058090 (326h29m46.633138221s) [noise=true , address=104.36.82.60:4343 , piece_id=UYPBBJF34FMAG25CPV77AYMLHAW43TS2O4BN5LMVXFWIQE5B5EUA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: <nil> Aug 22 07:55:52.202082717 (326h29m46.633162848s) [seg_pos={0 0}, upload=339674]: Segment reached optimal threshold of 14 pieces. Aug 22 07:55:52.202190443 (326h29m46.633270574s) [noise=true , address=104.36.82.51:4064 , piece_id=U4FDW4SPZBYYGLRTJB7Y2GSCQWGW7CXUX4VHTGLKWTW26PM3RXEA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HtP28UAricpA5ZBZrn2eLK1GBQxFGL2UNchDUFViqMhw4pXjy): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202231030 (326h29m46.633311161s) [noise=true , address=45.91.116.12:4241 , piece_id=SLFFR3CIK2LLX7ABT5JH5AQBYKTUS625B2N7FDZR7IIUXUH5VYSA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128wA5sH9sQDinHwwiTGL7WDktf6yD8EqQqy9mCxeZAKorYgsXD): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202285094 (326h29m46.633365225s) [noise=true , address=77.90.31.21:4888 , piece_id=25F35M47523MHKIHZ7GALEKPN4NUHZ6FXFKQXB5ELKRKRUQ6NA4A, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BiqwcDuvobZabx3jxDhXf27Ei8oLFS6wLp3qbpZCtJ4ZhQEZA): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202323127 (326h29m46.633403258s) [noise=true , address=77.90.31.15:4704 , piece_id=THLQDQD6TCZOCIXMFHMSHRWJNQM66USFLPB5YPTVYY2OOXD3BQWA, seg_pos={0 0}, upload=339674]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF Aug 22 07:55:52.202370437 (326h29m46.633450568s) [seg_pos={0 0}, upload=339674]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 07:55:52.202441453 (326h29m46.633521584s) [upload=339674]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 07:55:52.202445601 (326h29m46.633525722s) [upload=339674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 07:55:52.594911511 (326h29m47.025991643s) [upload=339674]: Done uploading segments... Aug 22 07:55:52.594930477 (326h29m47.026010598s) [upload=339674]: Upload finished. err: <nil> Duration: 5.985166538s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)