Orbiter History

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.298847605s FAIL (2025-06-24 03:15:25 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.298863385s edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 7.602860266s FAIL (2025-06-24 03:15:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.602901276s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000684944s FAIL (2025-06-24 03:15:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000707819s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.317587598s FAIL (2025-06-24 03:14:36 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.317612435s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.361927217s FAIL (2025-06-24 03:14:08 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.361958637s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.126251168s FAIL (2025-06-24 03:13:20 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.126278591s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.130664055s FAIL (2025-06-24 03:12:36 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.130698211s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.333572507s FAIL (2025-06-24 03:11:39 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.333595553s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.333344026s FAIL (2025-06-24 03:11:11 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.333374815s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.332877184s FAIL (2025-06-24 03:10:30 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.332908352s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.327823643s FAIL (2025-06-24 03:10:02 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.327852809s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.329479782s FAIL (2025-06-24 03:09:05 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.329506134s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.331197227s FAIL (2025-06-24 03:08:01 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.331231373s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.327343513s FAIL (2025-06-24 03:07:43 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.32736257s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.331145692s FAIL (2025-06-24 03:06:41 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.33116553s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.328450342s FAIL (2025-06-24 03:05:50 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.328532993s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.334622858s FAIL (2025-06-24 03:04:38 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.33465517s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.327617437s FAIL (2025-06-24 03:03:41 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.327659218s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m55.845079136s FAIL (2025-06-24 03:03:40 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1m55.845100739s edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.688275596s FAIL (2025-06-24 00:59:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.688305694s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.8274635s FAIL (2025-06-24 00:58:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.82748927s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.732142277s FAIL (2025-06-24 00:57:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.732161206s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.738944113s FAIL (2025-06-24 00:56:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.738966836s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 7.042141894s FAIL (2025-06-24 00:55:24 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.042166181s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 14.553357543s FAIL (2025-06-24 00:54:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 14.553380006s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.825327535s FAIL (2025-06-24 00:53:46 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.825352973s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.721617203s FAIL (2025-06-24 00:52:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.72164149s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.745727891s FAIL (2025-06-24 00:51:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.745751957s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.812636838s FAIL (2025-06-24 00:51:09 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.812668338s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.681477062s FAIL (2025-06-24 00:50:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.681503633s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.709953224s FAIL (2025-06-24 00:49:24 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.709974676s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.727729605s FAIL (2025-06-24 00:48:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.727756827s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.877104945s FAIL (2025-06-24 00:47:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.877136637s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.890628835s FAIL (2025-06-24 00:46:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.890653262s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.760759755s FAIL (2025-06-24 00:45:49 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.760784414s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 17.91016018s FAIL (2025-06-24 00:44:52 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 17.910188475s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.788210178s FAIL (2025-06-24 00:44:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.788233032s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.91221305s FAIL (2025-06-24 00:42:57 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.912239191s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.964298997s FAIL (2025-06-24 00:42:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.964327933s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 8.024631812s FAIL (2025-06-24 00:41:30 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.024655458s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.718755744s FAIL (2025-06-24 00:41:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.718781295s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.856517222s FAIL (2025-06-24 00:39:54 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.856538293s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.780627293s FAIL (2025-06-24 00:39:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.780663394s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.827928802s FAIL (2025-06-24 00:38:51 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.827957797s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 8.188539071s FAIL (2025-06-24 00:38:30 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.188561225s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.865673736s FAIL (2025-06-24 00:37:46 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.86570248s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.90671892s FAIL (2025-06-24 00:36:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.906736655s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 12.797783923s FAIL (2025-06-24 00:36:01 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 12.797813229s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 8.428179104s FAIL (2025-06-24 00:35:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.42820753s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.697589108s FAIL (2025-06-24 00:34:08 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== item: pb.BatchRequestItem_SegmentCommit Jun 24 00:11:42.157198426 (15h1m16.927839761s) [upload=12048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:11:42.450049193 (15h1m17.220690528s) [upload=12048]: Done uploading segments... Jun 24 00:11:42.450066877 (15h1m17.220708202s) [upload=12048]: Upload finished. err: <nil> Jun 24 00:12:16.443171088 (15h1m51.213812423s) [upload=12057]: Starting upload Jun 24 00:12:16.443229491 (15h1m51.213870826s) [upload=12057]: Done starting upload Jun 24 00:12:16.443319205 (15h1m51.21396054s) [upload=12057]: Uploading segments... Jun 24 00:12:16.443395563 (15h1m51.214036898s) [upload=12057]: Got next segment. Inline: false Jun 24 00:12:16.443450559 (15h1m51.214091894s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 00:12:16.443455449 (15h1m51.214096784s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 00:12:16.675669648 (15h1m51.446310983s) [seg_pos={0 0}, upload=12057]: Begin upload segment... Jun 24 00:12:16.675711580 (15h1m51.446352915s) [seg_pos={0 0}, upload=12057]: Done begin upload segment. Jun 24 00:12:16.675727090 (15h1m51.446368425s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675734424 (15h1m51.446375759s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.675779271 (15h1m51.446420606s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676047310 (15h1m51.446688645s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676362360 (15h1m51.447003695s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676611603 (15h1m51.447252928s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.676852970 (15h1m51.447494295s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677088898 (15h1m51.447730233s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677331437 (15h1m51.447972772s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677512408 (15h1m51.448153733s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677693899 (15h1m51.448335234s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.677889749 (15h1m51.448531084s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678077592 (15h1m51.448718927s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678271658 (15h1m51.448912993s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678456405 (15h1m51.44909774s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:16.678630232 (15h1m51.449271567s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Uploading piece... Jun 24 00:12:19.999055466 (15h1m54.769696801s) [upload=12057]: Next returned nil segment Jun 24 00:12:19.999072028 (15h1m54.769713363s) [upload=12057]: Waiting for error group managing segments... Jun 24 00:12:21.607904160 (15h1m56.378545515s) [noise=true , address=77.90.31.16:4735 , piece_id=ECJCPSCEU4W65OI5BWVYV4NDS4DQQXADVZEIWXLUAMGLCGWQTIUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:22.002262733 (15h1m56.772904068s) [noise=true , address=45.91.116.4:4938 , piece_id=X66EX7YS2BKP6BTUTT33NFYALDGFXRG3TAGFIHBVKUMAQRQIF77A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:23.413239398 (15h1m58.183880743s) [noise=true , address=77.90.31.15:4699 , piece_id=AB26UFQNVXFKPQHU4HXBX3YQJS2AZ5CSOZXRATGSTLNZ5FEDS4OQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:29.782792765 (15h2m4.55343409s) [noise=true , address=104.36.82.12:4150 , piece_id=ZHEGCNIGZE4IDJ5FFPRLDTBSKBJEIY5RGLVPSXKXV2ZTAF2FV56Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.316727859 (15h2m7.087369194s) [noise=true , address=45.91.116.6:4973 , piece_id=5BVW5JUYKZIIHB726X4NNT4ZEE52KGDFK4KADHBNSROYGRSC73GA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.681499920 (15h2m7.452141255s) [noise=true , address=45.91.116.11:4119 , piece_id=U3FQJPY3RWOLTSV7DVG4U6FR3P3UHYTGHQQ4IG7FONH2QOJXUOUA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:32.975780807 (15h2m7.746422143s) [noise=true , address=77.90.31.11:4555 , piece_id=S6WD4BAMIBUMKZSWXTCYBVUHL4TBXMIITQVHZW3UTWXD2EUUE6CQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:33.250070448 (15h2m8.020711773s) [noise=true , address=104.36.82.2:4732 , piece_id=KIGKYCLA2D4WHWOM2QDZ5TNCDCE7YFDPLS2YUWURD7TGKKRZ5A4A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:38.919160377 (15h2m13.689801702s) [noise=true , address=45.91.116.12:5226 , piece_id=M2VQ3W454TDGOZIRHWP3JQXQJLUEAF64G7CVB7BTUFPNPB3N673Q, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:41.005450406 (15h2m15.776091731s) [noise=true , address=45.91.116.9:5261 , piece_id=5GFRKEPC4NXUITR6FTLJQPJ7XNOGHJWRL2HMQGKOMZOVVSXABVQQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:42.842700256 (15h2m17.613341591s) [noise=true , address=45.91.116.10:4083 , piece_id=2PPW63BI72T4VXIWB2367TSJSVHTFRTD5USPEODNHFMGMP3CNYRQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:43.887133340 (15h2m18.657774675s) [noise=true , address=77.90.31.21:4879 , piece_id=ODKHVYV52OD6CTMKE2VMWP6SM33OIF673P4RLSUDR44WKWB3PJ3A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712295207 (15h2m20.482936542s) [noise=true , address=77.90.31.17:4771 , piece_id=PTVN5MFAOI3DIWMYMU5LXM45K4LKM2IXJ2T4E5HY3EPRIREJTM5A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: <nil> Jun 24 00:12:45.712324513 (15h2m20.482965848s) [seg_pos={0 0}, upload=12057]: Segment reached optimal threshold of 13 pieces. Jun 24 00:12:45.712573256 (15h2m20.483214581s) [noise=true , address=45.91.116.14:5190 , piece_id=IKDH4UDTYDKABABAKCYEVUXR3ZTH2U4YOD4HWAIJNKPOC6BPUQSQ, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47338->45.91.116.14:5190: use of closed network connection Jun 24 00:12:45.712594717 (15h2m20.483236052s) [noise=true , address=77.90.31.11:4553 , piece_id=LJMI6TYVG4HS47ZT3F4X2H7D3EWWSNVGDEY7VHFW6MRYTK6EPK6A, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57616->77.90.31.11:4553: use of closed network connection Jun 24 00:12:45.712620728 (15h2m20.483262063s) [noise=true , address=77.90.31.19:4842 , piece_id=NFGO24RAWX6U6H2LBBMOV6YTH5PKBPY7VD44KDCCSK7Q36TNC3KA, seg_pos={0 0}, upload=12057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42702->77.90.31.19:4842: use of closed network connection Jun 24 00:12:45.712648070 (15h2m20.483289405s) [seg_pos={0 0}, upload=12057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 00:12:45.712703899 (15h2m20.483345224s) [upload=12057]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 00:12:45.712707816 (15h2m20.483349151s) [upload=12057]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 00:12:46.031924157 (15h2m20.802565492s) [upload=12057]: Done uploading segments... Jun 24 00:12:46.031944617 (15h2m20.802585952s) [upload=12057]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.697617673s core uplink us-select-1

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)