Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.310063406s FAIL (2025-09-08 09:31:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.310092411s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X......X......] duration: 5.932119609s FAIL (2025-09-08 09:30:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:25:46.333593945 (43h57m22.373167065s) [upload=38642]: Starting upload Sep 8 09:25:46.333648169 (43h57m22.373221289s) [upload=38642]: Done starting upload Sep 8 09:25:46.333893929 (43h57m22.373467049s) [upload=38642]: Uploading segments... Sep 8 09:25:46.333937984 (43h57m22.373511104s) [upload=38642]: Got next segment. Inline: false Sep 8 09:25:46.333966008 (43h57m22.373539128s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:25:46.333970897 (43h57m22.373544017s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:25:46.584698149 (43h57m22.624271269s) [seg_pos={0 0}, upload=38642]: Begin upload segment... Sep 8 09:25:46.584754917 (43h57m22.624328047s) [seg_pos={0 0}, upload=38642]: Done begin upload segment. Sep 8 09:25:46.584776489 (43h57m22.624349609s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.584818238 (43h57m22.624391358s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585276355 (43h57m22.624849465s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585353523 (43h57m22.624926643s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585606326 (43h57m22.625179446s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586043563 (43h57m22.625616683s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586336043 (43h57m22.625909163s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586665193 (43h57m22.626238313s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586913658 (43h57m22.626486778s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587273256 (43h57m22.626846366s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587549274 (43h57m22.627122394s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587839700 (43h57m22.62741282s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588166846 (43h57m22.627739966s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588439828 (43h57m22.628012948s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588540491 (43h57m22.628113611s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588831407 (43h57m22.628404527s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:48.416216108 (43h57m24.455789228s) [upload=38642]: Next returned nil segment Sep 8 09:25:48.416233582 (43h57m24.455806702s) [upload=38642]: Waiting for error group managing segments... Sep 8 09:25:48.706816379 (43h57m24.746389499s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.720064200 (43h57m24.75963732s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.731640752 (43h57m24.771213872s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.740151257 (43h57m24.779724377s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.747697568 (43h57m24.787270678s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.763932565 (43h57m24.803505675s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.778393115 (43h57m24.817966235s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.788311766 (43h57m24.827884886s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.835735103 (43h57m24.875308223s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.892038573 (43h57m24.931611693s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.932303773 (43h57m24.971876893s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.954230531 (43h57m24.993803651s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280203539 (43h57m25.319776659s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280229348 (43h57m25.319802468s) [seg_pos={0 0}, upload=38642]: Segment reached optimal threshold of 13 pieces. Sep 8 09:25:49.280345430 (43h57m25.31991855s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280417839 (43h57m25.319990959s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280499605 (43h57m25.320072725s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: context canceled; context canceled Sep 8 09:25:49.280518131 (43h57m25.320091251s) [seg_pos={0 0}, upload=38642]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:25:49.280573697 (43h57m25.320146818s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:25:49.280577434 (43h57m25.320150555s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:25:49.635729270 (43h57m25.67530238s) [upload=38642]: Done uploading segments... Sep 8 09:25:49.635747835 (43h57m25.675320955s) [upload=38642]: Upload finished. err: <nil> Duration: 5.932146059s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.171956991s FAIL (2025-09-08 09:30:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.171989242s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.174929159s FAIL (2025-09-08 09:30:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.174963485s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X......X.....] duration: 6.402464675s FAIL (2025-09-08 09:29:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:25:46.333593945 (43h57m22.373167065s) [upload=38642]: Starting upload Sep 8 09:25:46.333648169 (43h57m22.373221289s) [upload=38642]: Done starting upload Sep 8 09:25:46.333893929 (43h57m22.373467049s) [upload=38642]: Uploading segments... Sep 8 09:25:46.333937984 (43h57m22.373511104s) [upload=38642]: Got next segment. Inline: false Sep 8 09:25:46.333966008 (43h57m22.373539128s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:25:46.333970897 (43h57m22.373544017s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:25:46.584698149 (43h57m22.624271269s) [seg_pos={0 0}, upload=38642]: Begin upload segment... Sep 8 09:25:46.584754917 (43h57m22.624328047s) [seg_pos={0 0}, upload=38642]: Done begin upload segment. Sep 8 09:25:46.584776489 (43h57m22.624349609s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.584818238 (43h57m22.624391358s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585276355 (43h57m22.624849465s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585353523 (43h57m22.624926643s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585606326 (43h57m22.625179446s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586043563 (43h57m22.625616683s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586336043 (43h57m22.625909163s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586665193 (43h57m22.626238313s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586913658 (43h57m22.626486778s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587273256 (43h57m22.626846366s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587549274 (43h57m22.627122394s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587839700 (43h57m22.62741282s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588166846 (43h57m22.627739966s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588439828 (43h57m22.628012948s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588540491 (43h57m22.628113611s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588831407 (43h57m22.628404527s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:48.416216108 (43h57m24.455789228s) [upload=38642]: Next returned nil segment Sep 8 09:25:48.416233582 (43h57m24.455806702s) [upload=38642]: Waiting for error group managing segments... Sep 8 09:25:48.706816379 (43h57m24.746389499s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.720064200 (43h57m24.75963732s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.731640752 (43h57m24.771213872s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.740151257 (43h57m24.779724377s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.747697568 (43h57m24.787270678s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.763932565 (43h57m24.803505675s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.778393115 (43h57m24.817966235s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.788311766 (43h57m24.827884886s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.835735103 (43h57m24.875308223s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.892038573 (43h57m24.931611693s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.932303773 (43h57m24.971876893s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.954230531 (43h57m24.993803651s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280203539 (43h57m25.319776659s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280229348 (43h57m25.319802468s) [seg_pos={0 0}, upload=38642]: Segment reached optimal threshold of 13 pieces. Sep 8 09:25:49.280345430 (43h57m25.31991855s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280417839 (43h57m25.319990959s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280499605 (43h57m25.320072725s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: context canceled; context canceled Sep 8 09:25:49.280518131 (43h57m25.320091251s) [seg_pos={0 0}, upload=38642]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:25:49.280573697 (43h57m25.320146818s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:25:49.280577434 (43h57m25.320150555s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:25:49.635729270 (43h57m25.67530238s) [upload=38642]: Done uploading segments... Sep 8 09:25:49.635747835 (43h57m25.675320955s) [upload=38642]: Upload finished. err: <nil> Duration: 6.402484321s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.183148154s FAIL (2025-09-08 09:29:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.183178541s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.950346277s FAIL (2025-09-08 09:29:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.950368711s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X......X....] duration: 13.346235302s FAIL (2025-09-08 09:29:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:25:46.333593945 (43h57m22.373167065s) [upload=38642]: Starting upload Sep 8 09:25:46.333648169 (43h57m22.373221289s) [upload=38642]: Done starting upload Sep 8 09:25:46.333893929 (43h57m22.373467049s) [upload=38642]: Uploading segments... Sep 8 09:25:46.333937984 (43h57m22.373511104s) [upload=38642]: Got next segment. Inline: false Sep 8 09:25:46.333966008 (43h57m22.373539128s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:25:46.333970897 (43h57m22.373544017s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:25:46.584698149 (43h57m22.624271269s) [seg_pos={0 0}, upload=38642]: Begin upload segment... Sep 8 09:25:46.584754917 (43h57m22.624328047s) [seg_pos={0 0}, upload=38642]: Done begin upload segment. Sep 8 09:25:46.584776489 (43h57m22.624349609s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.584818238 (43h57m22.624391358s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585276355 (43h57m22.624849465s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585353523 (43h57m22.624926643s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585606326 (43h57m22.625179446s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586043563 (43h57m22.625616683s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586336043 (43h57m22.625909163s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586665193 (43h57m22.626238313s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586913658 (43h57m22.626486778s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587273256 (43h57m22.626846366s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587549274 (43h57m22.627122394s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587839700 (43h57m22.62741282s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588166846 (43h57m22.627739966s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588439828 (43h57m22.628012948s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588540491 (43h57m22.628113611s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588831407 (43h57m22.628404527s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:48.416216108 (43h57m24.455789228s) [upload=38642]: Next returned nil segment Sep 8 09:25:48.416233582 (43h57m24.455806702s) [upload=38642]: Waiting for error group managing segments... Sep 8 09:25:48.706816379 (43h57m24.746389499s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.720064200 (43h57m24.75963732s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.731640752 (43h57m24.771213872s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.740151257 (43h57m24.779724377s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.747697568 (43h57m24.787270678s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.763932565 (43h57m24.803505675s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.778393115 (43h57m24.817966235s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.788311766 (43h57m24.827884886s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.835735103 (43h57m24.875308223s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.892038573 (43h57m24.931611693s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.932303773 (43h57m24.971876893s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.954230531 (43h57m24.993803651s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280203539 (43h57m25.319776659s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280229348 (43h57m25.319802468s) [seg_pos={0 0}, upload=38642]: Segment reached optimal threshold of 13 pieces. Sep 8 09:25:49.280345430 (43h57m25.31991855s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280417839 (43h57m25.319990959s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280499605 (43h57m25.320072725s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: context canceled; context canceled Sep 8 09:25:49.280518131 (43h57m25.320091251s) [seg_pos={0 0}, upload=38642]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:25:49.280573697 (43h57m25.320146818s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:25:49.280577434 (43h57m25.320150555s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:25:49.635729270 (43h57m25.67530238s) [upload=38642]: Done uploading segments... Sep 8 09:25:49.635747835 (43h57m25.675320955s) [upload=38642]: Upload finished. err: <nil> Duration: 13.346262514s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.337977123s FAIL (2025-09-08 09:28:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.338007411s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X......X...] duration: 7.424238762s FAIL (2025-09-08 09:28:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:25:46.333593945 (43h57m22.373167065s) [upload=38642]: Starting upload Sep 8 09:25:46.333648169 (43h57m22.373221289s) [upload=38642]: Done starting upload Sep 8 09:25:46.333893929 (43h57m22.373467049s) [upload=38642]: Uploading segments... Sep 8 09:25:46.333937984 (43h57m22.373511104s) [upload=38642]: Got next segment. Inline: false Sep 8 09:25:46.333966008 (43h57m22.373539128s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:25:46.333970897 (43h57m22.373544017s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:25:46.584698149 (43h57m22.624271269s) [seg_pos={0 0}, upload=38642]: Begin upload segment... Sep 8 09:25:46.584754917 (43h57m22.624328047s) [seg_pos={0 0}, upload=38642]: Done begin upload segment. Sep 8 09:25:46.584776489 (43h57m22.624349609s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.584818238 (43h57m22.624391358s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585276355 (43h57m22.624849465s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585353523 (43h57m22.624926643s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585606326 (43h57m22.625179446s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586043563 (43h57m22.625616683s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586336043 (43h57m22.625909163s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586665193 (43h57m22.626238313s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586913658 (43h57m22.626486778s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587273256 (43h57m22.626846366s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587549274 (43h57m22.627122394s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587839700 (43h57m22.62741282s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588166846 (43h57m22.627739966s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588439828 (43h57m22.628012948s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588540491 (43h57m22.628113611s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588831407 (43h57m22.628404527s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:48.416216108 (43h57m24.455789228s) [upload=38642]: Next returned nil segment Sep 8 09:25:48.416233582 (43h57m24.455806702s) [upload=38642]: Waiting for error group managing segments... Sep 8 09:25:48.706816379 (43h57m24.746389499s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.720064200 (43h57m24.75963732s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.731640752 (43h57m24.771213872s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.740151257 (43h57m24.779724377s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.747697568 (43h57m24.787270678s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.763932565 (43h57m24.803505675s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.778393115 (43h57m24.817966235s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.788311766 (43h57m24.827884886s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.835735103 (43h57m24.875308223s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.892038573 (43h57m24.931611693s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.932303773 (43h57m24.971876893s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.954230531 (43h57m24.993803651s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280203539 (43h57m25.319776659s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280229348 (43h57m25.319802468s) [seg_pos={0 0}, upload=38642]: Segment reached optimal threshold of 13 pieces. Sep 8 09:25:49.280345430 (43h57m25.31991855s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280417839 (43h57m25.319990959s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280499605 (43h57m25.320072725s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: context canceled; context canceled Sep 8 09:25:49.280518131 (43h57m25.320091251s) [seg_pos={0 0}, upload=38642]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:25:49.280573697 (43h57m25.320146818s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:25:49.280577434 (43h57m25.320150555s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:25:49.635729270 (43h57m25.67530238s) [upload=38642]: Done uploading segments... Sep 8 09:25:49.635747835 (43h57m25.675320955s) [upload=38642]: Upload finished. err: <nil> Duration: 7.42426907s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.34026639s FAIL (2025-09-08 09:27:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.340302058s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X......X..] duration: 6.399203302s FAIL (2025-09-08 09:27:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:25:46.333593945 (43h57m22.373167065s) [upload=38642]: Starting upload Sep 8 09:25:46.333648169 (43h57m22.373221289s) [upload=38642]: Done starting upload Sep 8 09:25:46.333893929 (43h57m22.373467049s) [upload=38642]: Uploading segments... Sep 8 09:25:46.333937984 (43h57m22.373511104s) [upload=38642]: Got next segment. Inline: false Sep 8 09:25:46.333966008 (43h57m22.373539128s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:25:46.333970897 (43h57m22.373544017s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:25:46.584698149 (43h57m22.624271269s) [seg_pos={0 0}, upload=38642]: Begin upload segment... Sep 8 09:25:46.584754917 (43h57m22.624328047s) [seg_pos={0 0}, upload=38642]: Done begin upload segment. Sep 8 09:25:46.584776489 (43h57m22.624349609s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.584818238 (43h57m22.624391358s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585276355 (43h57m22.624849465s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585353523 (43h57m22.624926643s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585606326 (43h57m22.625179446s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586043563 (43h57m22.625616683s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586336043 (43h57m22.625909163s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586665193 (43h57m22.626238313s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586913658 (43h57m22.626486778s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587273256 (43h57m22.626846366s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587549274 (43h57m22.627122394s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587839700 (43h57m22.62741282s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588166846 (43h57m22.627739966s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588439828 (43h57m22.628012948s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588540491 (43h57m22.628113611s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588831407 (43h57m22.628404527s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:48.416216108 (43h57m24.455789228s) [upload=38642]: Next returned nil segment Sep 8 09:25:48.416233582 (43h57m24.455806702s) [upload=38642]: Waiting for error group managing segments... Sep 8 09:25:48.706816379 (43h57m24.746389499s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.720064200 (43h57m24.75963732s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.731640752 (43h57m24.771213872s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.740151257 (43h57m24.779724377s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.747697568 (43h57m24.787270678s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.763932565 (43h57m24.803505675s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.778393115 (43h57m24.817966235s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.788311766 (43h57m24.827884886s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.835735103 (43h57m24.875308223s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.892038573 (43h57m24.931611693s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.932303773 (43h57m24.971876893s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.954230531 (43h57m24.993803651s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280203539 (43h57m25.319776659s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280229348 (43h57m25.319802468s) [seg_pos={0 0}, upload=38642]: Segment reached optimal threshold of 13 pieces. Sep 8 09:25:49.280345430 (43h57m25.31991855s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280417839 (43h57m25.319990959s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280499605 (43h57m25.320072725s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: context canceled; context canceled Sep 8 09:25:49.280518131 (43h57m25.320091251s) [seg_pos={0 0}, upload=38642]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:25:49.280573697 (43h57m25.320146818s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:25:49.280577434 (43h57m25.320150555s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:25:49.635729270 (43h57m25.67530238s) [upload=38642]: Done uploading segments... Sep 8 09:25:49.635747835 (43h57m25.675320955s) [upload=38642]: Upload finished. err: <nil> Duration: 6.399223571s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.242747403s FAIL (2025-09-08 09:26:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.24277655s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X......X.] duration: 6.311701631s FAIL (2025-09-08 09:26:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:25:46.333593945 (43h57m22.373167065s) [upload=38642]: Starting upload Sep 8 09:25:46.333648169 (43h57m22.373221289s) [upload=38642]: Done starting upload Sep 8 09:25:46.333893929 (43h57m22.373467049s) [upload=38642]: Uploading segments... Sep 8 09:25:46.333937984 (43h57m22.373511104s) [upload=38642]: Got next segment. Inline: false Sep 8 09:25:46.333966008 (43h57m22.373539128s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:25:46.333970897 (43h57m22.373544017s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:25:46.584698149 (43h57m22.624271269s) [seg_pos={0 0}, upload=38642]: Begin upload segment... Sep 8 09:25:46.584754917 (43h57m22.624328047s) [seg_pos={0 0}, upload=38642]: Done begin upload segment. Sep 8 09:25:46.584776489 (43h57m22.624349609s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.584818238 (43h57m22.624391358s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585276355 (43h57m22.624849465s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585353523 (43h57m22.624926643s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585606326 (43h57m22.625179446s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586043563 (43h57m22.625616683s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586336043 (43h57m22.625909163s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586665193 (43h57m22.626238313s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586913658 (43h57m22.626486778s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587273256 (43h57m22.626846366s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587549274 (43h57m22.627122394s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587839700 (43h57m22.62741282s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588166846 (43h57m22.627739966s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588439828 (43h57m22.628012948s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588540491 (43h57m22.628113611s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588831407 (43h57m22.628404527s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:48.416216108 (43h57m24.455789228s) [upload=38642]: Next returned nil segment Sep 8 09:25:48.416233582 (43h57m24.455806702s) [upload=38642]: Waiting for error group managing segments... Sep 8 09:25:48.706816379 (43h57m24.746389499s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.720064200 (43h57m24.75963732s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.731640752 (43h57m24.771213872s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.740151257 (43h57m24.779724377s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.747697568 (43h57m24.787270678s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.763932565 (43h57m24.803505675s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.778393115 (43h57m24.817966235s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.788311766 (43h57m24.827884886s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.835735103 (43h57m24.875308223s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.892038573 (43h57m24.931611693s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.932303773 (43h57m24.971876893s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.954230531 (43h57m24.993803651s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280203539 (43h57m25.319776659s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280229348 (43h57m25.319802468s) [seg_pos={0 0}, upload=38642]: Segment reached optimal threshold of 13 pieces. Sep 8 09:25:49.280345430 (43h57m25.31991855s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280417839 (43h57m25.319990959s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280499605 (43h57m25.320072725s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: context canceled; context canceled Sep 8 09:25:49.280518131 (43h57m25.320091251s) [seg_pos={0 0}, upload=38642]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:25:49.280573697 (43h57m25.320146818s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:25:49.280577434 (43h57m25.320150555s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:25:49.635729270 (43h57m25.67530238s) [upload=38642]: Done uploading segments... Sep 8 09:25:49.635747835 (43h57m25.675320955s) [upload=38642]: Upload finished. err: <nil> Duration: 6.311717854s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X......X] duration: 30.001990781s FAIL (2025-09-08 09:26:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:25:46.333593945 (43h57m22.373167065s) [upload=38642]: Starting upload Sep 8 09:25:46.333648169 (43h57m22.373221289s) [upload=38642]: Done starting upload Sep 8 09:25:46.333893929 (43h57m22.373467049s) [upload=38642]: Uploading segments... Sep 8 09:25:46.333937984 (43h57m22.373511104s) [upload=38642]: Got next segment. Inline: false Sep 8 09:25:46.333966008 (43h57m22.373539128s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:25:46.333970897 (43h57m22.373544017s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:25:46.584698149 (43h57m22.624271269s) [seg_pos={0 0}, upload=38642]: Begin upload segment... Sep 8 09:25:46.584754917 (43h57m22.624328047s) [seg_pos={0 0}, upload=38642]: Done begin upload segment. Sep 8 09:25:46.584776489 (43h57m22.624349609s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.584818238 (43h57m22.624391358s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585276355 (43h57m22.624849465s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585353523 (43h57m22.624926643s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.585606326 (43h57m22.625179446s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586043563 (43h57m22.625616683s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586336043 (43h57m22.625909163s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586665193 (43h57m22.626238313s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.586913658 (43h57m22.626486778s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587273256 (43h57m22.626846366s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587549274 (43h57m22.627122394s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.587839700 (43h57m22.62741282s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588166846 (43h57m22.627739966s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588439828 (43h57m22.628012948s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588540491 (43h57m22.628113611s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:46.588831407 (43h57m22.628404527s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Uploading piece... Sep 8 09:25:48.416216108 (43h57m24.455789228s) [upload=38642]: Next returned nil segment Sep 8 09:25:48.416233582 (43h57m24.455806702s) [upload=38642]: Waiting for error group managing segments... Sep 8 09:25:48.706816379 (43h57m24.746389499s) [noise=true , address=77.90.31.15:4697 , piece_id=QH7WX6YZAE7AOD6FACJTSSIDHJ2HSJRE7JHHR7AGB6LM6S3GEEYQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.720064200 (43h57m24.75963732s) [noise=true , address=145.79.227.6:4257 , piece_id=CFRXJIWCJ7SAW2BJF7HXHDIMMJRESPLZUFT2Z7EIBZ2WGVFGSD5A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.731640752 (43h57m24.771213872s) [noise=true , address=77.90.31.18:4807 , piece_id=WZNSGQKIDJ3EAHXROJR74E44YLYUEM2SFS3ZBCJT363FPLBEWINA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.740151257 (43h57m24.779724377s) [noise=true , address=145.79.227.7:4294 , piece_id=47QI6YSPZ5VEKTYWX44A5IP3GFMLQSKYAOMMNKZWJBPMZ4YIXO4A, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.747697568 (43h57m24.787270678s) [noise=true , address=145.79.227.14:4839 , piece_id=L6LVIWKRRYOM7GA6UZK26OMAE7JNEKK36JO65PSJSW3JNZFYZS3Q, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.763932565 (43h57m24.803505675s) [noise=true , address=145.79.227.5:4223 , piece_id=VELFRCJP2CIORCTSNSFFTHJNTIVC4VPPVJRM3JOKBSMNCATM6BFQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.778393115 (43h57m24.817966235s) [noise=true , address=45.91.116.12:4226 , piece_id=WSBGZKI2CKW6LA7F766ULCDZB3V3LT5XFEXYYVPBZ7XVQL26KKMA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.788311766 (43h57m24.827884886s) [noise=true , address=77.90.31.14:4663 , piece_id=5BXBLQ3GWJSV3MKK6BXTVNAAG5VFIPJLQPD32IF4XW6RVRG7GRIQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.835735103 (43h57m24.875308223s) [noise=true , address=77.90.31.10:4518 , piece_id=G267WVK4NVVH4NKMJTVF2F3I6QVXLVJPHH6MD5OOTMZ26CITW6FA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.892038573 (43h57m24.931611693s) [noise=true , address=45.91.116.11:4117 , piece_id=4F5FFHVXYIH246YHZTAM7TR6ECTWIF7EU7UWBLIPHBNLGZSWBDIA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.932303773 (43h57m24.971876893s) [noise=true , address=45.91.116.6:4975 , piece_id=I5M4OQOHSYJ22SYD3Z6LJRMTFPDFKO5RUK6UWB56R6GTRQ34H3WQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:48.954230531 (43h57m24.993803651s) [noise=true , address=145.79.227.5:4222 , piece_id=YN63W66CKWZ4CXDVUEAVW325EKUKOEVXYEH47XILDJDPN2V7CNUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280203539 (43h57m25.319776659s) [noise=true , address=145.79.227.4:4187 , piece_id=V4OBIC37BA2GDA2RNYLDWIQKP6IREMZUCCYAUNPCUTQTUCMDI3VQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: <nil> Sep 8 09:25:49.280229348 (43h57m25.319802468s) [seg_pos={0 0}, upload=38642]: Segment reached optimal threshold of 13 pieces. Sep 8 09:25:49.280345430 (43h57m25.31991855s) [noise=true , address=145.79.227.15:4876 , piece_id=QGV2OOHQ6RDRIQK3JHYALZKZ7GW2IW2K63KOCEWS5WAR2EEUCYCA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280417839 (43h57m25.319990959s) [noise=true , address=145.79.227.17:4971 , piece_id=534NHVVX6YOE43JXC53MV4F2HYMKLPJKNOYMHYFMREY22G54T7NQ, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Sep 8 09:25:49.280499605 (43h57m25.320072725s) [noise=true , address=45.91.116.7:4010 , piece_id=6DA66OZZ4OCSFGSACVXRXPZY55GPR4NKSWQ6IQL4WUDBVUCDEFUA, seg_pos={0 0}, upload=38642]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: context canceled; context canceled Sep 8 09:25:49.280518131 (43h57m25.320091251s) [seg_pos={0 0}, upload=38642]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:25:49.280573697 (43h57m25.320146818s) [upload=38642]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:25:49.280577434 (43h57m25.320150555s) [upload=38642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:25:49.635729270 (43h57m25.67530238s) [upload=38642]: Done uploading segments... Sep 8 09:25:49.635747835 (43h57m25.675320955s) [upload=38642]: Upload finished. err: <nil> Duration: 30.002023393s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.068546419s FAIL (2025-09-08 09:25:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.06857785s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.900856645s FAIL (2025-09-08 09:25:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:20:29.113835200 (43h52m5.15340832s) [upload=38567]: Starting upload Sep 8 09:20:29.113906977 (43h52m5.153480097s) [upload=38567]: Done starting upload Sep 8 09:20:29.114005596 (43h52m5.153578726s) [upload=38567]: Uploading segments... Sep 8 09:20:29.114083154 (43h52m5.153656274s) [upload=38567]: Got next segment. Inline: false Sep 8 09:20:29.114117830 (43h52m5.15369095s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:20:29.114123731 (43h52m5.153696851s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:20:29.391985814 (43h52m5.431558944s) [seg_pos={0 0}, upload=38567]: Begin upload segment... Sep 8 09:20:29.392036290 (43h52m5.43160941s) [seg_pos={0 0}, upload=38567]: Done begin upload segment. Sep 8 09:20:29.392062891 (43h52m5.431636011s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392110372 (43h52m5.431683492s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392496641 (43h52m5.432069761s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392797046 (43h52m5.432370176s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393093413 (43h52m5.432666533s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393402865 (43h52m5.432975985s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393701727 (43h52m5.433274857s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394044954 (43h52m5.433618074s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394403360 (43h52m5.43397647s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394845546 (43h52m5.434418676s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395225172 (43h52m5.434798292s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395486483 (43h52m5.435059603s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395512833 (43h52m5.435085953s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395836232 (43h52m5.435409352s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396145804 (43h52m5.435718934s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396406002 (43h52m5.435979122s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:31.162841755 (43h52m7.202414876s) [upload=38567]: Next returned nil segment Sep 8 09:20:31.162858999 (43h52m7.202432129s) [upload=38567]: Waiting for error group managing segments... Sep 8 09:20:31.502425125 (43h52m7.541998235s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.517366636 (43h52m7.556939756s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.527520927 (43h52m7.567094047s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.534361407 (43h52m7.573934527s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.536526470 (43h52m7.57609959s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.544918318 (43h52m7.584491438s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.565992094 (43h52m7.605565214s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.571763719 (43h52m7.611336839s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.640055719 (43h52m7.679628839s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.664036477 (43h52m7.703609597s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.717358692 (43h52m7.756931812s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.866378609 (43h52m7.90595173s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937170795 (43h52m7.976743915s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937202225 (43h52m7.976775345s) [seg_pos={0 0}, upload=38567]: Segment reached optimal threshold of 13 pieces. Sep 8 09:20:31.937488863 (43h52m7.977061983s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection Sep 8 09:20:31.937608151 (43h52m7.977181271s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: read tcp 188.166.225.170:59014->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 09:20:31.937618401 (43h52m7.977191521s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection Sep 8 09:20:31.937675610 (43h52m7.97724874s) [seg_pos={0 0}, upload=38567]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:20:31.937789287 (43h52m7.977362407s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:20:31.937822221 (43h52m7.977395341s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:20:32.239283231 (43h52m8.278856351s) [upload=38567]: Done uploading segments... Sep 8 09:20:32.239303149 (43h52m8.278876269s) [upload=38567]: Upload finished. err: <nil> Duration: 5.900886973s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.283477435s FAIL (2025-09-08 09:24:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.283507983s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.249193393s FAIL (2025-09-08 09:24:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.249221147s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.964024088s FAIL (2025-09-08 09:23:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:20:29.113835200 (43h52m5.15340832s) [upload=38567]: Starting upload Sep 8 09:20:29.113906977 (43h52m5.153480097s) [upload=38567]: Done starting upload Sep 8 09:20:29.114005596 (43h52m5.153578726s) [upload=38567]: Uploading segments... Sep 8 09:20:29.114083154 (43h52m5.153656274s) [upload=38567]: Got next segment. Inline: false Sep 8 09:20:29.114117830 (43h52m5.15369095s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:20:29.114123731 (43h52m5.153696851s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:20:29.391985814 (43h52m5.431558944s) [seg_pos={0 0}, upload=38567]: Begin upload segment... Sep 8 09:20:29.392036290 (43h52m5.43160941s) [seg_pos={0 0}, upload=38567]: Done begin upload segment. Sep 8 09:20:29.392062891 (43h52m5.431636011s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392110372 (43h52m5.431683492s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392496641 (43h52m5.432069761s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392797046 (43h52m5.432370176s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393093413 (43h52m5.432666533s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393402865 (43h52m5.432975985s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393701727 (43h52m5.433274857s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394044954 (43h52m5.433618074s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394403360 (43h52m5.43397647s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394845546 (43h52m5.434418676s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395225172 (43h52m5.434798292s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395486483 (43h52m5.435059603s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395512833 (43h52m5.435085953s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395836232 (43h52m5.435409352s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396145804 (43h52m5.435718934s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396406002 (43h52m5.435979122s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:31.162841755 (43h52m7.202414876s) [upload=38567]: Next returned nil segment Sep 8 09:20:31.162858999 (43h52m7.202432129s) [upload=38567]: Waiting for error group managing segments... Sep 8 09:20:31.502425125 (43h52m7.541998235s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.517366636 (43h52m7.556939756s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.527520927 (43h52m7.567094047s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.534361407 (43h52m7.573934527s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.536526470 (43h52m7.57609959s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.544918318 (43h52m7.584491438s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.565992094 (43h52m7.605565214s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.571763719 (43h52m7.611336839s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.640055719 (43h52m7.679628839s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.664036477 (43h52m7.703609597s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.717358692 (43h52m7.756931812s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.866378609 (43h52m7.90595173s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937170795 (43h52m7.976743915s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937202225 (43h52m7.976775345s) [seg_pos={0 0}, upload=38567]: Segment reached optimal threshold of 13 pieces. Sep 8 09:20:31.937488863 (43h52m7.977061983s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection Sep 8 09:20:31.937608151 (43h52m7.977181271s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: read tcp 188.166.225.170:59014->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 09:20:31.937618401 (43h52m7.977191521s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection Sep 8 09:20:31.937675610 (43h52m7.97724874s) [seg_pos={0 0}, upload=38567]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:20:31.937789287 (43h52m7.977362407s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:20:31.937822221 (43h52m7.977395341s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:20:32.239283231 (43h52m8.278856351s) [upload=38567]: Done uploading segments... Sep 8 09:20:32.239303149 (43h52m8.278876269s) [upload=38567]: Upload finished. err: <nil> Duration: 5.964054695s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.078785279s FAIL (2025-09-08 09:23:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.078828562s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.986295511s FAIL (2025-09-08 09:23:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:20:29.113835200 (43h52m5.15340832s) [upload=38567]: Starting upload Sep 8 09:20:29.113906977 (43h52m5.153480097s) [upload=38567]: Done starting upload Sep 8 09:20:29.114005596 (43h52m5.153578726s) [upload=38567]: Uploading segments... Sep 8 09:20:29.114083154 (43h52m5.153656274s) [upload=38567]: Got next segment. Inline: false Sep 8 09:20:29.114117830 (43h52m5.15369095s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:20:29.114123731 (43h52m5.153696851s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:20:29.391985814 (43h52m5.431558944s) [seg_pos={0 0}, upload=38567]: Begin upload segment... Sep 8 09:20:29.392036290 (43h52m5.43160941s) [seg_pos={0 0}, upload=38567]: Done begin upload segment. Sep 8 09:20:29.392062891 (43h52m5.431636011s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392110372 (43h52m5.431683492s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392496641 (43h52m5.432069761s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392797046 (43h52m5.432370176s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393093413 (43h52m5.432666533s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393402865 (43h52m5.432975985s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393701727 (43h52m5.433274857s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394044954 (43h52m5.433618074s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394403360 (43h52m5.43397647s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394845546 (43h52m5.434418676s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395225172 (43h52m5.434798292s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395486483 (43h52m5.435059603s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395512833 (43h52m5.435085953s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395836232 (43h52m5.435409352s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396145804 (43h52m5.435718934s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396406002 (43h52m5.435979122s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:31.162841755 (43h52m7.202414876s) [upload=38567]: Next returned nil segment Sep 8 09:20:31.162858999 (43h52m7.202432129s) [upload=38567]: Waiting for error group managing segments... Sep 8 09:20:31.502425125 (43h52m7.541998235s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.517366636 (43h52m7.556939756s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.527520927 (43h52m7.567094047s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.534361407 (43h52m7.573934527s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.536526470 (43h52m7.57609959s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.544918318 (43h52m7.584491438s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.565992094 (43h52m7.605565214s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.571763719 (43h52m7.611336839s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.640055719 (43h52m7.679628839s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.664036477 (43h52m7.703609597s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.717358692 (43h52m7.756931812s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.866378609 (43h52m7.90595173s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937170795 (43h52m7.976743915s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937202225 (43h52m7.976775345s) [seg_pos={0 0}, upload=38567]: Segment reached optimal threshold of 13 pieces. Sep 8 09:20:31.937488863 (43h52m7.977061983s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection Sep 8 09:20:31.937608151 (43h52m7.977181271s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: read tcp 188.166.225.170:59014->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 09:20:31.937618401 (43h52m7.977191521s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection Sep 8 09:20:31.937675610 (43h52m7.97724874s) [seg_pos={0 0}, upload=38567]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:20:31.937789287 (43h52m7.977362407s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:20:31.937822221 (43h52m7.977395341s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:20:32.239283231 (43h52m8.278856351s) [upload=38567]: Done uploading segments... Sep 8 09:20:32.239303149 (43h52m8.278876269s) [upload=38567]: Upload finished. err: <nil> Duration: 5.986324077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.871686266s FAIL (2025-09-08 09:22:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:20:29.113835200 (43h52m5.15340832s) [upload=38567]: Starting upload Sep 8 09:20:29.113906977 (43h52m5.153480097s) [upload=38567]: Done starting upload Sep 8 09:20:29.114005596 (43h52m5.153578726s) [upload=38567]: Uploading segments... Sep 8 09:20:29.114083154 (43h52m5.153656274s) [upload=38567]: Got next segment. Inline: false Sep 8 09:20:29.114117830 (43h52m5.15369095s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:20:29.114123731 (43h52m5.153696851s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:20:29.391985814 (43h52m5.431558944s) [seg_pos={0 0}, upload=38567]: Begin upload segment... Sep 8 09:20:29.392036290 (43h52m5.43160941s) [seg_pos={0 0}, upload=38567]: Done begin upload segment. Sep 8 09:20:29.392062891 (43h52m5.431636011s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392110372 (43h52m5.431683492s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392496641 (43h52m5.432069761s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392797046 (43h52m5.432370176s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393093413 (43h52m5.432666533s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393402865 (43h52m5.432975985s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393701727 (43h52m5.433274857s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394044954 (43h52m5.433618074s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394403360 (43h52m5.43397647s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394845546 (43h52m5.434418676s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395225172 (43h52m5.434798292s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395486483 (43h52m5.435059603s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395512833 (43h52m5.435085953s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395836232 (43h52m5.435409352s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396145804 (43h52m5.435718934s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396406002 (43h52m5.435979122s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:31.162841755 (43h52m7.202414876s) [upload=38567]: Next returned nil segment Sep 8 09:20:31.162858999 (43h52m7.202432129s) [upload=38567]: Waiting for error group managing segments... Sep 8 09:20:31.502425125 (43h52m7.541998235s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.517366636 (43h52m7.556939756s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.527520927 (43h52m7.567094047s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.534361407 (43h52m7.573934527s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.536526470 (43h52m7.57609959s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.544918318 (43h52m7.584491438s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.565992094 (43h52m7.605565214s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.571763719 (43h52m7.611336839s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.640055719 (43h52m7.679628839s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.664036477 (43h52m7.703609597s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.717358692 (43h52m7.756931812s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.866378609 (43h52m7.90595173s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937170795 (43h52m7.976743915s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937202225 (43h52m7.976775345s) [seg_pos={0 0}, upload=38567]: Segment reached optimal threshold of 13 pieces. Sep 8 09:20:31.937488863 (43h52m7.977061983s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection Sep 8 09:20:31.937608151 (43h52m7.977181271s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: read tcp 188.166.225.170:59014->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 09:20:31.937618401 (43h52m7.977191521s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection Sep 8 09:20:31.937675610 (43h52m7.97724874s) [seg_pos={0 0}, upload=38567]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:20:31.937789287 (43h52m7.977362407s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:20:31.937822221 (43h52m7.977395341s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:20:32.239283231 (43h52m8.278856351s) [upload=38567]: Done uploading segments... Sep 8 09:20:32.239303149 (43h52m8.278876269s) [upload=38567]: Upload finished. err: <nil> Duration: 5.871709111s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.425836798s FAIL (2025-09-08 09:22:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.425864922s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.953949008s FAIL (2025-09-08 09:22:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:20:29.113835200 (43h52m5.15340832s) [upload=38567]: Starting upload Sep 8 09:20:29.113906977 (43h52m5.153480097s) [upload=38567]: Done starting upload Sep 8 09:20:29.114005596 (43h52m5.153578726s) [upload=38567]: Uploading segments... Sep 8 09:20:29.114083154 (43h52m5.153656274s) [upload=38567]: Got next segment. Inline: false Sep 8 09:20:29.114117830 (43h52m5.15369095s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:20:29.114123731 (43h52m5.153696851s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:20:29.391985814 (43h52m5.431558944s) [seg_pos={0 0}, upload=38567]: Begin upload segment... Sep 8 09:20:29.392036290 (43h52m5.43160941s) [seg_pos={0 0}, upload=38567]: Done begin upload segment. Sep 8 09:20:29.392062891 (43h52m5.431636011s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392110372 (43h52m5.431683492s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392496641 (43h52m5.432069761s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392797046 (43h52m5.432370176s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393093413 (43h52m5.432666533s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393402865 (43h52m5.432975985s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393701727 (43h52m5.433274857s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394044954 (43h52m5.433618074s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394403360 (43h52m5.43397647s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394845546 (43h52m5.434418676s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395225172 (43h52m5.434798292s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395486483 (43h52m5.435059603s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395512833 (43h52m5.435085953s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395836232 (43h52m5.435409352s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396145804 (43h52m5.435718934s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396406002 (43h52m5.435979122s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:31.162841755 (43h52m7.202414876s) [upload=38567]: Next returned nil segment Sep 8 09:20:31.162858999 (43h52m7.202432129s) [upload=38567]: Waiting for error group managing segments... Sep 8 09:20:31.502425125 (43h52m7.541998235s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.517366636 (43h52m7.556939756s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.527520927 (43h52m7.567094047s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.534361407 (43h52m7.573934527s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.536526470 (43h52m7.57609959s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.544918318 (43h52m7.584491438s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.565992094 (43h52m7.605565214s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.571763719 (43h52m7.611336839s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.640055719 (43h52m7.679628839s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.664036477 (43h52m7.703609597s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.717358692 (43h52m7.756931812s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.866378609 (43h52m7.90595173s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937170795 (43h52m7.976743915s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937202225 (43h52m7.976775345s) [seg_pos={0 0}, upload=38567]: Segment reached optimal threshold of 13 pieces. Sep 8 09:20:31.937488863 (43h52m7.977061983s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection Sep 8 09:20:31.937608151 (43h52m7.977181271s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: read tcp 188.166.225.170:59014->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 09:20:31.937618401 (43h52m7.977191521s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection Sep 8 09:20:31.937675610 (43h52m7.97724874s) [seg_pos={0 0}, upload=38567]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:20:31.937789287 (43h52m7.977362407s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:20:31.937822221 (43h52m7.977395341s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:20:32.239283231 (43h52m8.278856351s) [upload=38567]: Done uploading segments... Sep 8 09:20:32.239303149 (43h52m8.278876269s) [upload=38567]: Upload finished. err: <nil> Duration: 5.95397612s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.17706277s FAIL (2025-09-08 09:21:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.177170235s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.634029729s FAIL (2025-09-08 09:21:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:20:29.113835200 (43h52m5.15340832s) [upload=38567]: Starting upload Sep 8 09:20:29.113906977 (43h52m5.153480097s) [upload=38567]: Done starting upload Sep 8 09:20:29.114005596 (43h52m5.153578726s) [upload=38567]: Uploading segments... Sep 8 09:20:29.114083154 (43h52m5.153656274s) [upload=38567]: Got next segment. Inline: false Sep 8 09:20:29.114117830 (43h52m5.15369095s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:20:29.114123731 (43h52m5.153696851s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:20:29.391985814 (43h52m5.431558944s) [seg_pos={0 0}, upload=38567]: Begin upload segment... Sep 8 09:20:29.392036290 (43h52m5.43160941s) [seg_pos={0 0}, upload=38567]: Done begin upload segment. Sep 8 09:20:29.392062891 (43h52m5.431636011s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392110372 (43h52m5.431683492s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392496641 (43h52m5.432069761s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392797046 (43h52m5.432370176s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393093413 (43h52m5.432666533s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393402865 (43h52m5.432975985s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393701727 (43h52m5.433274857s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394044954 (43h52m5.433618074s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394403360 (43h52m5.43397647s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394845546 (43h52m5.434418676s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395225172 (43h52m5.434798292s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395486483 (43h52m5.435059603s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395512833 (43h52m5.435085953s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395836232 (43h52m5.435409352s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396145804 (43h52m5.435718934s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396406002 (43h52m5.435979122s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:31.162841755 (43h52m7.202414876s) [upload=38567]: Next returned nil segment Sep 8 09:20:31.162858999 (43h52m7.202432129s) [upload=38567]: Waiting for error group managing segments... Sep 8 09:20:31.502425125 (43h52m7.541998235s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.517366636 (43h52m7.556939756s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.527520927 (43h52m7.567094047s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.534361407 (43h52m7.573934527s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.536526470 (43h52m7.57609959s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.544918318 (43h52m7.584491438s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.565992094 (43h52m7.605565214s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.571763719 (43h52m7.611336839s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.640055719 (43h52m7.679628839s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.664036477 (43h52m7.703609597s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.717358692 (43h52m7.756931812s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.866378609 (43h52m7.90595173s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937170795 (43h52m7.976743915s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937202225 (43h52m7.976775345s) [seg_pos={0 0}, upload=38567]: Segment reached optimal threshold of 13 pieces. Sep 8 09:20:31.937488863 (43h52m7.977061983s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection Sep 8 09:20:31.937608151 (43h52m7.977181271s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: read tcp 188.166.225.170:59014->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 09:20:31.937618401 (43h52m7.977191521s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection Sep 8 09:20:31.937675610 (43h52m7.97724874s) [seg_pos={0 0}, upload=38567]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:20:31.937789287 (43h52m7.977362407s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:20:31.937822221 (43h52m7.977395341s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:20:32.239283231 (43h52m8.278856351s) [upload=38567]: Done uploading segments... Sep 8 09:20:32.239303149 (43h52m8.278876269s) [upload=38567]: Upload finished. err: <nil> Duration: 6.634069965s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001801995s FAIL (2025-09-08 09:20:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 09:20:29.113835200 (43h52m5.15340832s) [upload=38567]: Starting upload Sep 8 09:20:29.113906977 (43h52m5.153480097s) [upload=38567]: Done starting upload Sep 8 09:20:29.114005596 (43h52m5.153578726s) [upload=38567]: Uploading segments... Sep 8 09:20:29.114083154 (43h52m5.153656274s) [upload=38567]: Got next segment. Inline: false Sep 8 09:20:29.114117830 (43h52m5.15369095s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 09:20:29.114123731 (43h52m5.153696851s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 09:20:29.391985814 (43h52m5.431558944s) [seg_pos={0 0}, upload=38567]: Begin upload segment... Sep 8 09:20:29.392036290 (43h52m5.43160941s) [seg_pos={0 0}, upload=38567]: Done begin upload segment. Sep 8 09:20:29.392062891 (43h52m5.431636011s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392110372 (43h52m5.431683492s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392496641 (43h52m5.432069761s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.392797046 (43h52m5.432370176s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393093413 (43h52m5.432666533s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393402865 (43h52m5.432975985s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.393701727 (43h52m5.433274857s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394044954 (43h52m5.433618074s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394403360 (43h52m5.43397647s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.394845546 (43h52m5.434418676s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395225172 (43h52m5.434798292s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395486483 (43h52m5.435059603s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395512833 (43h52m5.435085953s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.395836232 (43h52m5.435409352s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396145804 (43h52m5.435718934s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:29.396406002 (43h52m5.435979122s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Uploading piece... Sep 8 09:20:31.162841755 (43h52m7.202414876s) [upload=38567]: Next returned nil segment Sep 8 09:20:31.162858999 (43h52m7.202432129s) [upload=38567]: Waiting for error group managing segments... Sep 8 09:20:31.502425125 (43h52m7.541998235s) [noise=true , address=145.79.227.2:4113 , piece_id=SRYBGNXTUGGXAHU7WRMBA5TNZR7KSGJ5FC44PEDBKKV474KPS7SA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.517366636 (43h52m7.556939756s) [noise=true , address=145.79.227.19:4077 , piece_id=MOJJXVG6XC6U5O4B3PE6GAW6JWJLE4LRWU32LZWGM72GQGAVIWPQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.527520927 (43h52m7.567094047s) [noise=true , address=45.91.116.9:4261 , piece_id=P5XKAPWPBTWA5OCMW3CYKD5EWUAOTIWKS3YYI6UP3U2T6L3ZS4XA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.534361407 (43h52m7.573934527s) [noise=true , address=145.79.227.18:4007 , piece_id=QIIGQJOK224DUQH5V4UVTDGZHQMWHLM2VXXHXJY33TR2OW6C5JZQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.536526470 (43h52m7.57609959s) [noise=true , address=77.90.31.15:4697 , piece_id=2C3WNAKFJZA7W6JEA2ACRNXRY3ET6RHZNDXU6OIUYW7KYWGO25BQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.544918318 (43h52m7.584491438s) [noise=true , address=145.79.227.17:4972 , piece_id=E5JZBBTKXTEDEX63PDGNO7XTBGV5KHDEBRVBFWS4YGGWGAWW4IIQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.565992094 (43h52m7.605565214s) [noise=true , address=145.79.227.15:4874 , piece_id=MR4LSI5UXBIZPY4RIGIXXV36SRB2MI4L3C5RG5CDPNLWLKSMOU6A, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.571763719 (43h52m7.611336839s) [noise=true , address=145.79.227.4:4186 , piece_id=AUFBF6QLVRPPRK3QFJIG544UJ7E4JJ7WVGNTT2EX2O5BFQK4RG6Q, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.640055719 (43h52m7.679628839s) [noise=true , address=45.91.116.12:4226 , piece_id=ZD53Q3ELFK4FF4LF3OEYQGCPY7VWHC7JRV7D2GZ2JKBOH3REQZTQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.664036477 (43h52m7.703609597s) [noise=true , address=145.79.227.15:4873 , piece_id=QWJRIBIUKXCQSH2XYUCVW7BXZALJDZAWMTZS2NJ52JBGWNRMCQHA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.717358692 (43h52m7.756931812s) [noise=true , address=45.91.116.11:4119 , piece_id=XDWCJOU3EAAXK27YUHOBF6MG552ARSRDIVINRJJCGRCFOVSTKONA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.866378609 (43h52m7.90595173s) [noise=true , address=145.79.227.14:4839 , piece_id=PX7N72T42LEYCX5F4NEQLDWFILBH32DTW3F6JO366DPJD7PYQZBA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937170795 (43h52m7.976743915s) [noise=true , address=145.79.227.6:4257 , piece_id=TMGOIUHZY3BVH5SWUV4DRARYV7GPRA55B3KQRKKCDVRA37MNYYWA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: <nil> Sep 8 09:20:31.937202225 (43h52m7.976775345s) [seg_pos={0 0}, upload=38567]: Segment reached optimal threshold of 13 pieces. Sep 8 09:20:31.937488863 (43h52m7.977061983s) [noise=true , address=45.91.116.6:4974 , piece_id=GIGZCJEUGTIJJUETGTDRI52DY4WB3OXHQA3I72WMHXJMF7ENPPEQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36628->45.91.116.6:4974: use of closed network connection Sep 8 09:20:31.937608151 (43h52m7.977181271s) [noise=true , address=145.79.227.6:4259 , piece_id=VOAHPQ6UR4FLIF5Z2QV6XUM3RYWMPGGOXSA7BMXA37CKUPIRTQJQ, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: read tcp 188.166.225.170:59014->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 09:20:31.937618401 (43h52m7.977191521s) [noise=true , address=45.91.116.9:4263 , piece_id=C2LQS3MOMVMBKZTZDSXGQON545O34KLLZLPBV26DU5SMP4XWNIRA, seg_pos={0 0}, upload=38567]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47712->45.91.116.9:4263: use of closed network connection Sep 8 09:20:31.937675610 (43h52m7.97724874s) [seg_pos={0 0}, upload=38567]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 09:20:31.937789287 (43h52m7.977362407s) [upload=38567]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 09:20:31.937822221 (43h52m7.977395341s) [upload=38567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 09:20:32.239283231 (43h52m8.278856351s) [upload=38567]: Done uploading segments... Sep 8 09:20:32.239303149 (43h52m8.278876269s) [upload=38567]: Upload finished. err: <nil> Duration: 30.001819417s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.363174662s FAIL (2025-09-08 09:20:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.363196674s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.107530405s FAIL (2025-09-08 09:20:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.107561985s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.179633478s FAIL (2025-09-08 09:19:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.179681218s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.254399497s FAIL (2025-09-08 09:19:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.254426778s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.211839407s FAIL (2025-09-08 09:18:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.211864445s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.562584814s FAIL (2025-09-08 09:18:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.56261424s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.079989557s FAIL (2025-09-08 09:16:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.080010857s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.083268891s FAIL (2025-09-08 09:15:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.083293739s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.568481257s FAIL (2025-09-08 09:15:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.568515232s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.934750095s FAIL (2025-09-08 09:13:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.934776065s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.403640966s FAIL (2025-09-08 09:12:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.40366861s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.174298878s FAIL (2025-09-08 09:12:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.174333976s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.207738088s FAIL (2025-09-08 09:11:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.20776525s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.335996626s FAIL (2025-09-08 09:11:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.336023347s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.343705296s FAIL (2025-09-08 09:10:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.343732829s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.008170074s FAIL (2025-09-08 09:09:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.008195933s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.259353015s FAIL (2025-09-08 09:08:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.259398892s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.264919366s FAIL (2025-09-08 09:07:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.264945255s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.129669079s FAIL (2025-09-08 09:07:18 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.129690138s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.258510452s FAIL (2025-09-08 09:06:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.25854527s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.178357351s FAIL (2025-09-08 09:06:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.178380746s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.972350408s FAIL (2025-09-08 09:05:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.9723824s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)