Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration: 5.831422759s FAIL (2025-07-28 00:16:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 4h38m49.468321249s) [noise=true , address=45.91.116.12:4225 , piece_id=7O4KTDOCFH2LH42FZN6UB56MO42UADU4VPZL3WV76ATOAIN3T4XQ, seg_pos={0 0}, upload=81244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: expected piece hash; context canceled; EOF Jul 28 00:14:39.745767448 (84h38m49.468330488s) [seg_pos={0 0}, upload=81244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:14:39.745916893 (84h38m49.468479933s) [upload=81244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:14:39.745921191 (84h38m49.468484231s) [upload=81244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:14:40.037599193 (84h38m49.760162233s) [upload=81244]: Done uploading segments... Jul 28 00:14:40.037615805 (84h38m49.760178845s) [upload=81244]: Upload finished. err: <nil> Jul 28 00:15:04.480798899 (84h39m14.20336194s) [upload=81252]: Starting upload Jul 28 00:15:04.480876769 (84h39m14.203439839s) [upload=81252]: Done starting upload Jul 28 00:15:04.481001578 (84h39m14.203564628s) [upload=81252]: Uploading segments... Jul 28 00:15:04.481081461 (84h39m14.203644501s) [upload=81252]: Got next segment. Inline: false Jul 28 00:15:04.481113221 (84h39m14.203676282s) [upload=81252]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:15:04.481119724 (84h39m14.203682764s) [upload=81252]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:15:04.716839411 (84h39m14.439402461s) [seg_pos={0 0}, upload=81252]: Begin upload segment... Jul 28 00:15:04.716900478 (84h39m14.439463528s) [seg_pos={0 0}, upload=81252]: Done begin upload segment. Jul 28 00:15:04.716928301 (84h39m14.439491351s) [noise=true , address=45.91.116.6:4973 , piece_id=Q4QGSWOSVLFAGBJVJ6MY3WBQSRVPUVGAKOBBWQXD2KTJWX7JXXNA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.716959711 (84h39m14.439522751s) [noise=true , address=45.91.116.7:4010 , piece_id=IDN2SM6QUYUYNTU4QZXULENX63SP3DE7YLOZ5V2XGFS7TPLZDD3A, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717364165 (84h39m14.439927205s) [noise=true , address=104.36.82.8:4970 , piece_id=OQBN2SMVR7DCWABX75PHXBVT2JFH4E336LQHXQDHYR5HXDNA6E4Q, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717377661 (84h39m14.439940701s) [noise=true , address=104.36.82.11:4113 , piece_id=7BSZUMUDAUNNYNVMVXFTOYD7CTWVSRCLCZGOMP3QJTE547M5HXVQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717621617 (84h39m14.440184658s) [noise=true , address=45.91.116.12:4226 , piece_id=XQYIJYMKLGOTI5NHR7TE7FW5P54KBQSIM5RVIS3JZUO5EBNGU7QQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717695910 (84h39m14.44025895s) [noise=true , address=45.91.116.6:4975 , piece_id=K2GNEYG5JIEDQXQNB7RYVK7UAWOZ3RTO3U3AZPGH6FLRUE3HISOQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717898938 (84h39m14.440461978s) [noise=true , address=77.90.31.18:4807 , piece_id=SB2EOKTVXXPHDQQEHB4YJBBXLOXEBQN7KQSRBOVZP42ZGIUSIU7Q, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718043215 (84h39m14.440606255s) [noise=true , address=77.90.31.12:4592 , piece_id=LH4YNTF4IXLG3CVWSUIDXX2XTOEFMPCFEFD3RYST6IFO7VCGNBKQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718351064 (84h39m14.440914114s) [noise=true , address=45.91.116.10:4081 , piece_id=6ODMN4RNRD577D7Y2IW7VAQYWXSLUX4A2VDJRDRUTMSHAUNUSNZQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718650747 (84h39m14.441213787s) [noise=true , address=77.90.31.21:4877 , piece_id=6FMP75OPY5ROWCJKEDRKVTCONJ3GTHEQTYLQG2SPWEK7BWNIP5VQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718948056 (84h39m14.441511096s) [noise=true , address=104.36.82.7:4911 , piece_id=JNMBXPYUEDWN3WNCQCQHR4B7DCIDDRX22GW57NEP543OWYYEWIZA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719239924 (84h39m14.441802974s) [noise=true , address=45.91.116.5:4299 , piece_id=DKCLRZ5J3GKZHBMK3IALNT35KH7XCMCLONPJDYP3YFAMXFK5E3CQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719543695 (84h39m14.442106735s) [noise=true , address=45.91.116.14:4189 , piece_id=7FBJZBG5CJDWWS4TGKJATJSSBLSPZXPRNOOPHIPYMLKPKTHYMTQQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719846184 (84h39m14.442409224s) [noise=true , address=104.36.82.16:4293 , piece_id=ZWJUPUSTFIPB6FGUUWOOVIYXNCWPUF567DF6327BU76FW2EMYKNA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.720157299 (84h39m14.442720339s) [noise=true , address=45.91.116.4:4937 , piece_id=RTPEK3HBRIWLZNQRXNKFGD34GGBR5QX4FHYQUFOUJHN23XX2OZCA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.720484405 (84h39m14.443047455s) [noise=true , address=77.90.31.13:4627 , piece_id=7OTR55UTQONXNMRT5LM43BN7W5HYH5KHCLSSMOHU33AF2YJ4JUCA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:06.449685788 (84h39m16.172248828s) [upload=81252]: Next returned nil segment Jul 28 00:15:06.449705004 (84h39m16.172268084s) [upload=81252]: Waiting for error group managing segments... Jul 28 00:15:06.740940750 (84h39m16.46350378s) [noise=true , address=77.90.31.18:4807 , piece_id=SB2EOKTVXXPHDQQEHB4YJBBXLOXEBQN7KQSRBOVZP42ZGIUSIU7Q, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.741446858 (84h39m16.464009898s) [noise=true , address=77.90.31.12:4592 , piece_id=LH4YNTF4IXLG3CVWSUIDXX2XTOEFMPCFEFD3RYST6IFO7VCGNBKQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.747334472 (84h39m16.469897542s) [noise=true , address=45.91.116.6:4973 , piece_id=Q4QGSWOSVLFAGBJVJ6MY3WBQSRVPUVGAKOBBWQXD2KTJWX7JXXNA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.748805717 (84h39m16.471368747s) [noise=true , address=45.91.116.10:4081 , piece_id=6ODMN4RNRD577D7Y2IW7VAQYWXSLUX4A2VDJRDRUTMSHAUNUSNZQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.815890697 (84h39m16.538453737s) [noise=true , address=45.91.116.4:4937 , piece_id=RTPEK3HBRIWLZNQRXNKFGD34GGBR5QX4FHYQUFOUJHN23XX2OZCA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.819563003 (84h39m16.542126043s) [noise=true , address=77.90.31.21:4877 , piece_id=6FMP75OPY5ROWCJKEDRKVTCONJ3GTHEQTYLQG2SPWEK7BWNIP5VQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.830587626 (84h39m16.553150666s) [noise=true , address=45.91.116.5:4299 , piece_id=DKCLRZ5J3GKZHBMK3IALNT35KH7XCMCLONPJDYP3YFAMXFK5E3CQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.842458518 (84h39m16.565021558s) [noise=true , address=77.90.31.13:4627 , piece_id=7OTR55UTQONXNMRT5LM43BN7W5HYH5KHCLSSMOHU33AF2YJ4JUCA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.846136164 (84h39m16.568699204s) [noise=true , address=45.91.116.6:4975 , piece_id=K2GNEYG5JIEDQXQNB7RYVK7UAWOZ3RTO3U3AZPGH6FLRUE3HISOQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.857847821 (84h39m16.580410861s) [noise=true , address=45.91.116.14:4189 , piece_id=7FBJZBG5CJDWWS4TGKJATJSSBLSPZXPRNOOPHIPYMLKPKTHYMTQQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.892512974 (84h39m16.615076035s) [noise=true , address=45.91.116.7:4010 , piece_id=IDN2SM6QUYUYNTU4QZXULENX63SP3DE7YLOZ5V2XGFS7TPLZDD3A, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.898154658 (84h39m16.620717729s) [noise=true , address=45.91.116.12:4226 , piece_id=XQYIJYMKLGOTI5NHR7TE7FW5P54KBQSIM5RVIS3JZUO5EBNGU7QQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:33.823200918 (84h39m43.545763958s) [noise=true , address=104.36.82.16:4293 , piece_id=ZWJUPUSTFIPB6FGUUWOOVIYXNCWPUF567DF6327BU76FW2EMYKNA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: rpc: dial tcp 104.36.82.16:4293: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823269078 (84h39m43.545832118s) [noise=true , address=104.36.82.8:4970 , piece_id=OQBN2SMVR7DCWABX75PHXBVT2JFH4E336LQHXQDHYR5HXDNA6E4Q, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:104.36.82.8:4970): protocol: rpc: dial tcp 104.36.82.8:4970: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823301911 (84h39m43.545864951s) [noise=true , address=104.36.82.7:4911 , piece_id=JNMBXPYUEDWN3WNCQCQHR4B7DCIDDRX22GW57NEP543OWYYEWIZA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:104.36.82.7:4911): protocol: rpc: dial tcp 104.36.82.7:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823310658 (84h39m43.545873728s) [noise=true , address=104.36.82.11:4113 , piece_id=7BSZUMUDAUNNYNVMVXFTOYD7CTWVSRCLCZGOMP3QJTE547M5HXVQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:41026->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823344703 (84h39m43.545907743s) [seg_pos={0 0}, upload=81252]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 28 00:15:34.056565111 (84h39m43.779128151s) [upload=81252]: Done uploading segments... Jul 28 00:15:34.056591671 (84h39m43.779154711s) [upload=81252]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.83144999s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.008775427s FAIL (2025-07-28 00:16:31 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.00880365s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X............X.......] duration: 1.905069773s FAIL (2025-07-28 00:16:19 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.905096363s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X.X.] duration: 5.876948712s FAIL (2025-07-28 00:15:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 4h38m49.468321249s) [noise=true , address=45.91.116.12:4225 , piece_id=7O4KTDOCFH2LH42FZN6UB56MO42UADU4VPZL3WV76ATOAIN3T4XQ, seg_pos={0 0}, upload=81244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: expected piece hash; context canceled; EOF Jul 28 00:14:39.745767448 (84h38m49.468330488s) [seg_pos={0 0}, upload=81244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:14:39.745916893 (84h38m49.468479933s) [upload=81244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:14:39.745921191 (84h38m49.468484231s) [upload=81244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:14:40.037599193 (84h38m49.760162233s) [upload=81244]: Done uploading segments... Jul 28 00:14:40.037615805 (84h38m49.760178845s) [upload=81244]: Upload finished. err: <nil> Jul 28 00:15:04.480798899 (84h39m14.20336194s) [upload=81252]: Starting upload Jul 28 00:15:04.480876769 (84h39m14.203439839s) [upload=81252]: Done starting upload Jul 28 00:15:04.481001578 (84h39m14.203564628s) [upload=81252]: Uploading segments... Jul 28 00:15:04.481081461 (84h39m14.203644501s) [upload=81252]: Got next segment. Inline: false Jul 28 00:15:04.481113221 (84h39m14.203676282s) [upload=81252]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:15:04.481119724 (84h39m14.203682764s) [upload=81252]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:15:04.716839411 (84h39m14.439402461s) [seg_pos={0 0}, upload=81252]: Begin upload segment... Jul 28 00:15:04.716900478 (84h39m14.439463528s) [seg_pos={0 0}, upload=81252]: Done begin upload segment. Jul 28 00:15:04.716928301 (84h39m14.439491351s) [noise=true , address=45.91.116.6:4973 , piece_id=Q4QGSWOSVLFAGBJVJ6MY3WBQSRVPUVGAKOBBWQXD2KTJWX7JXXNA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.716959711 (84h39m14.439522751s) [noise=true , address=45.91.116.7:4010 , piece_id=IDN2SM6QUYUYNTU4QZXULENX63SP3DE7YLOZ5V2XGFS7TPLZDD3A, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717364165 (84h39m14.439927205s) [noise=true , address=104.36.82.8:4970 , piece_id=OQBN2SMVR7DCWABX75PHXBVT2JFH4E336LQHXQDHYR5HXDNA6E4Q, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717377661 (84h39m14.439940701s) [noise=true , address=104.36.82.11:4113 , piece_id=7BSZUMUDAUNNYNVMVXFTOYD7CTWVSRCLCZGOMP3QJTE547M5HXVQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717621617 (84h39m14.440184658s) [noise=true , address=45.91.116.12:4226 , piece_id=XQYIJYMKLGOTI5NHR7TE7FW5P54KBQSIM5RVIS3JZUO5EBNGU7QQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717695910 (84h39m14.44025895s) [noise=true , address=45.91.116.6:4975 , piece_id=K2GNEYG5JIEDQXQNB7RYVK7UAWOZ3RTO3U3AZPGH6FLRUE3HISOQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717898938 (84h39m14.440461978s) [noise=true , address=77.90.31.18:4807 , piece_id=SB2EOKTVXXPHDQQEHB4YJBBXLOXEBQN7KQSRBOVZP42ZGIUSIU7Q, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718043215 (84h39m14.440606255s) [noise=true , address=77.90.31.12:4592 , piece_id=LH4YNTF4IXLG3CVWSUIDXX2XTOEFMPCFEFD3RYST6IFO7VCGNBKQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718351064 (84h39m14.440914114s) [noise=true , address=45.91.116.10:4081 , piece_id=6ODMN4RNRD577D7Y2IW7VAQYWXSLUX4A2VDJRDRUTMSHAUNUSNZQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718650747 (84h39m14.441213787s) [noise=true , address=77.90.31.21:4877 , piece_id=6FMP75OPY5ROWCJKEDRKVTCONJ3GTHEQTYLQG2SPWEK7BWNIP5VQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718948056 (84h39m14.441511096s) [noise=true , address=104.36.82.7:4911 , piece_id=JNMBXPYUEDWN3WNCQCQHR4B7DCIDDRX22GW57NEP543OWYYEWIZA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719239924 (84h39m14.441802974s) [noise=true , address=45.91.116.5:4299 , piece_id=DKCLRZ5J3GKZHBMK3IALNT35KH7XCMCLONPJDYP3YFAMXFK5E3CQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719543695 (84h39m14.442106735s) [noise=true , address=45.91.116.14:4189 , piece_id=7FBJZBG5CJDWWS4TGKJATJSSBLSPZXPRNOOPHIPYMLKPKTHYMTQQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719846184 (84h39m14.442409224s) [noise=true , address=104.36.82.16:4293 , piece_id=ZWJUPUSTFIPB6FGUUWOOVIYXNCWPUF567DF6327BU76FW2EMYKNA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.720157299 (84h39m14.442720339s) [noise=true , address=45.91.116.4:4937 , piece_id=RTPEK3HBRIWLZNQRXNKFGD34GGBR5QX4FHYQUFOUJHN23XX2OZCA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.720484405 (84h39m14.443047455s) [noise=true , address=77.90.31.13:4627 , piece_id=7OTR55UTQONXNMRT5LM43BN7W5HYH5KHCLSSMOHU33AF2YJ4JUCA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:06.449685788 (84h39m16.172248828s) [upload=81252]: Next returned nil segment Jul 28 00:15:06.449705004 (84h39m16.172268084s) [upload=81252]: Waiting for error group managing segments... Jul 28 00:15:06.740940750 (84h39m16.46350378s) [noise=true , address=77.90.31.18:4807 , piece_id=SB2EOKTVXXPHDQQEHB4YJBBXLOXEBQN7KQSRBOVZP42ZGIUSIU7Q, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.741446858 (84h39m16.464009898s) [noise=true , address=77.90.31.12:4592 , piece_id=LH4YNTF4IXLG3CVWSUIDXX2XTOEFMPCFEFD3RYST6IFO7VCGNBKQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.747334472 (84h39m16.469897542s) [noise=true , address=45.91.116.6:4973 , piece_id=Q4QGSWOSVLFAGBJVJ6MY3WBQSRVPUVGAKOBBWQXD2KTJWX7JXXNA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.748805717 (84h39m16.471368747s) [noise=true , address=45.91.116.10:4081 , piece_id=6ODMN4RNRD577D7Y2IW7VAQYWXSLUX4A2VDJRDRUTMSHAUNUSNZQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.815890697 (84h39m16.538453737s) [noise=true , address=45.91.116.4:4937 , piece_id=RTPEK3HBRIWLZNQRXNKFGD34GGBR5QX4FHYQUFOUJHN23XX2OZCA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.819563003 (84h39m16.542126043s) [noise=true , address=77.90.31.21:4877 , piece_id=6FMP75OPY5ROWCJKEDRKVTCONJ3GTHEQTYLQG2SPWEK7BWNIP5VQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.830587626 (84h39m16.553150666s) [noise=true , address=45.91.116.5:4299 , piece_id=DKCLRZ5J3GKZHBMK3IALNT35KH7XCMCLONPJDYP3YFAMXFK5E3CQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.842458518 (84h39m16.565021558s) [noise=true , address=77.90.31.13:4627 , piece_id=7OTR55UTQONXNMRT5LM43BN7W5HYH5KHCLSSMOHU33AF2YJ4JUCA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.846136164 (84h39m16.568699204s) [noise=true , address=45.91.116.6:4975 , piece_id=K2GNEYG5JIEDQXQNB7RYVK7UAWOZ3RTO3U3AZPGH6FLRUE3HISOQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.857847821 (84h39m16.580410861s) [noise=true , address=45.91.116.14:4189 , piece_id=7FBJZBG5CJDWWS4TGKJATJSSBLSPZXPRNOOPHIPYMLKPKTHYMTQQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.892512974 (84h39m16.615076035s) [noise=true , address=45.91.116.7:4010 , piece_id=IDN2SM6QUYUYNTU4QZXULENX63SP3DE7YLOZ5V2XGFS7TPLZDD3A, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.898154658 (84h39m16.620717729s) [noise=true , address=45.91.116.12:4226 , piece_id=XQYIJYMKLGOTI5NHR7TE7FW5P54KBQSIM5RVIS3JZUO5EBNGU7QQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:33.823200918 (84h39m43.545763958s) [noise=true , address=104.36.82.16:4293 , piece_id=ZWJUPUSTFIPB6FGUUWOOVIYXNCWPUF567DF6327BU76FW2EMYKNA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: rpc: dial tcp 104.36.82.16:4293: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823269078 (84h39m43.545832118s) [noise=true , address=104.36.82.8:4970 , piece_id=OQBN2SMVR7DCWABX75PHXBVT2JFH4E336LQHXQDHYR5HXDNA6E4Q, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:104.36.82.8:4970): protocol: rpc: dial tcp 104.36.82.8:4970: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823301911 (84h39m43.545864951s) [noise=true , address=104.36.82.7:4911 , piece_id=JNMBXPYUEDWN3WNCQCQHR4B7DCIDDRX22GW57NEP543OWYYEWIZA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:104.36.82.7:4911): protocol: rpc: dial tcp 104.36.82.7:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823310658 (84h39m43.545873728s) [noise=true , address=104.36.82.11:4113 , piece_id=7BSZUMUDAUNNYNVMVXFTOYD7CTWVSRCLCZGOMP3QJTE547M5HXVQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:41026->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823344703 (84h39m43.545907743s) [seg_pos={0 0}, upload=81252]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 28 00:15:34.056565111 (84h39m43.779128151s) [upload=81252]: Done uploading segments... Jul 28 00:15:34.056591671 (84h39m43.779154711s) [upload=81252]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.876972637s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [.................................................X...XXXXXXX] duration: 1m0.229436487s FAIL (2025-07-28 00:15:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== : Uploading piece... Jul 28 00:14:53.331896307 (84h39m3.054459347s) [noise=true , address=104.36.82.46:4488 , piece_id=4S57UPCVJQGDDJW6EEJMKTEJNDXUUDCX4UCDWTROVDUPF6TVOLUA, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:53.332130846 (84h39m3.054693886s) [noise=true , address=104.36.82.42:4812 , piece_id=KHVC7T4LZBS5EFCM3NUY3BGAGLYKSSXHIFADD3XZ57SOLXM4SUJA, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:53.332396654 (84h39m3.054959694s) [noise=true , address=104.36.82.9:4032 , piece_id=GNBIEEQ2FDSZYIHGASPQ5QHYMMK7PQTM7URHIHBWQDLECI6SQRSA, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:53.332618228 (84h39m3.055181268s) [noise=true , address=104.36.82.4:4828 , piece_id=EZIFSYBIGFQFTCNMFFGHG5XYIT2UO6SVMZBH4PUGMPZDHCE3VVVQ, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:53.332842558 (84h39m3.055405588s) [noise=true , address=104.36.82.49:4990 , piece_id=FCXU7726KRDGV2ZMIWOCMNFO2PRBY4GAFLXK6PLV6KM2XODFYYBQ, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:53.333070313 (84h39m3.055633353s) [noise=true , address=104.36.82.15:4279 , piece_id=R4IDM5KBBZKVLKDVFCTUH4FYI7JHJEEVWEXMXCZE3OEV5DCT5CJQ, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:53.333287098 (84h39m3.055850128s) [noise=true , address=104.36.82.13:4188 , piece_id=K2ZWCGD2ZJU7RL6Z3NV3LZ3Z7OA62F6ULRUWDHGVWEGLUOZU4IXA, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:53.333504775 (84h39m3.056067815s) [noise=true , address=104.36.82.55:4201 , piece_id=MRRUQF7KYU3ZDKWEYDSMTAYY5HFSFY6UFFW7TSAP2J6GDPITG2AQ, seg_pos={0 0}, upload=81249]: Uploading piece... Jul 28 00:14:54.841644854 (84h39m4.564207894s) [upload=81249]: Next returned nil segment Jul 28 00:14:54.841663019 (84h39m4.564226059s) [upload=81249]: Waiting for error group managing segments... Jul 28 00:14:55.226766917 (84h39m4.949329957s) [noise=true , address=79.127.201.214:4291 , piece_id=MAF5NZGDQY64EMZXE7KTO76PQLE4EDAGY642BXCKC4FWFKFGCPEA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: <nil> Jul 28 00:14:56.329867134 (84h39m6.052430175s) [noise=true , address=64.49.13.140:4508 , piece_id=6INZQBFHYBJFICMBZB6ZNNH225TO6LRZ65JTAJRBLD6KE3ZJCOVA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: <nil> Jul 28 00:15:52.240213723 (84h40m1.962776763s) [noise=true , address=104.36.82.5:4842 , piece_id=BQACPUFGZCKZHCTZRRXE77KNMIFLOVCJIGHDJGV3WDYPWNYQB6SQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn, address:104.36.82.5:4842): protocol: rpc: dial tcp 104.36.82.5:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.240287545 (84h40m1.962850585s) [noise=true , address=104.36.82.47:4528 , piece_id=DULYM42F56QCMRCAJPQHC4I3SNMQE3YEDA5UEEY7TCEJ2SXSBWVQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12ArcCrcHdpNgBMfTcPdtTXb65RgnTh8N32ihHAx2RrddxnRYgT, address:104.36.82.47:4528): protocol: rpc: dial tcp 104.36.82.47:4528: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.240507244 (84h40m1.963070284s) [noise=true , address=104.36.82.14:4240 , piece_id=RT47AXFOZSGNOOAGUHG6U4BBRNL3ZTTWMAS7OEZ33F7RQPVDTAHA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:104.36.82.14:4240): protocol: rpc: dial tcp 104.36.82.14:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.240566037 (84h40m1.963129108s) [noise=true , address=104.36.82.12:4184 , piece_id=O2OHDSYBKHHF3ZCSVBYEHGVDO3N24BFXWUNPUDELV52ZACXOCFHA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls, address:104.36.82.12:4184): protocol: rpc: dial tcp 104.36.82.12:4184: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.240616984 (84h40m1.963180034s) [noise=true , address=104.36.82.4:4828 , piece_id=EZIFSYBIGFQFTCNMFFGHG5XYIT2UO6SVMZBH4PUGMPZDHCE3VVVQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ, address:104.36.82.4:4828): protocol: write tcp 188.166.225.170:46712->104.36.82.4:4828: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.240685956 (84h40m1.963248997s) [noise=true , address=104.36.82.42:4812 , piece_id=KHVC7T4LZBS5EFCM3NUY3BGAGLYKSSXHIFADD3XZ57SOLXM4SUJA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:1TmXeVTeejZvrWi2RPxMutM6kXuZiMCtPxQBwL4tq6mhoLwFQo, address:104.36.82.42:4812): protocol: write tcp 188.166.225.170:53524->104.36.82.42:4812: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.240730933 (84h40m1.963293973s) [noise=true , address=104.36.82.46:4502 , piece_id=IK6H4XUBDSC27HNUSCAYS7D3OXBMCLIARPPCFTMB6H5XDS225DCA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12HP5xuRAGgTsL11UQh7VRgfuFzwNdEMXgc8zPVv4QknStyv6Ta, address:104.36.82.46:4502): protocol: rpc: dial tcp 104.36.82.46:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.240886610 (84h40m1.96344965s) [noise=true , address=104.36.82.3:4799 , piece_id=VMYQUXIGXCPHFFPAYMBTIBKQ6SDN62NO6IU2C66RESUUHOZNNRTQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: rpc: dial tcp 104.36.82.3:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241047739 (84h40m1.963610779s) [noise=true , address=104.36.82.45:4936 , piece_id=PCTADNWF4UUA27YJBIRMNWCGHOIRKA7ZGRNAH4DPQHSMI72NOBGA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:1DicJh1hd5NUoj9uxoqzeaCmjGHwfk2VUaA9zQFmv72wBdBoW8, address:104.36.82.45:4936): protocol: rpc: dial tcp 104.36.82.45:4936: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241141237 (84h40m1.963704287s) [noise=true , address=104.36.82.15:4279 , piece_id=R4IDM5KBBZKVLKDVFCTUH4FYI7JHJEEVWEXMXCZE3OEV5DCT5CJQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12uiA6tmZtmHDNaNtkhRtH31q4MJxn3C4bfrLAXmYz5mKmofHoG, address:104.36.82.15:4279): protocol: write tcp 188.166.225.170:56188->104.36.82.15:4279: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241230919 (84h40m1.963793959s) [noise=true , address=104.36.82.9:4032 , piece_id=GNBIEEQ2FDSZYIHGASPQ5QHYMMK7PQTM7URHIHBWQDLECI6SQRSA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:1ferXUYkCNRALvKCfTAfqHrNuDJZcqAx7Qx3hr7TaaMdVGzxQQ, address:104.36.82.9:4032): protocol: write tcp 188.166.225.170:52692->104.36.82.9:4032: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241269803 (84h40m1.963832853s) [noise=true , address=104.36.82.54:4182 , piece_id=7JBUEBASEJEFJ7HIIU2OED56QSN4REZEUZLAMXQNTEVHOXEMPMXQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy, address:104.36.82.54:4182): protocol: rpc: dial tcp 104.36.82.54:4182: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241310532 (84h40m1.963873582s) [noise=true , address=104.36.82.13:4188 , piece_id=K2ZWCGD2ZJU7RL6Z3NV3LZ3Z7OA62F6ULRUWDHGVWEGLUOZU4IXA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:104.36.82.13:4188): protocol: rpc: dial tcp 104.36.82.13:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241319639 (84h40m1.963882679s) [noise=true , address=104.36.82.46:4488 , piece_id=4S57UPCVJQGDDJW6EEJMKTEJNDXUUDCX4UCDWTROVDUPF6TVOLUA, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:1MU3fdv9cTkq4pUZ3h989STAG1wxrbhFgzmr6tcrfumZKHP9BZ, address:104.36.82.46:4488): protocol: write tcp 188.166.225.170:35244->104.36.82.46:4488: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241353343 (84h40m1.963916393s) [noise=true , address=104.36.82.49:4990 , piece_id=FCXU7726KRDGV2ZMIWOCMNFO2PRBY4GAFLXK6PLV6KM2XODFYYBQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:1gDzCKcMaLTisHw68GYkMbcMJF7rbKnUt48etS8Q7KeiXedbU4, address:104.36.82.49:4990): protocol: write tcp 188.166.225.170:35316->104.36.82.49:4990: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241372310 (84h40m1.96393535s) [noise=true , address=104.36.82.55:4201 , piece_id=MRRUQF7KYU3ZDKWEYDSMTAYY5HFSFY6UFFW7TSAP2J6GDPITG2AQ, seg_pos={0 0}, upload=81249]: Done uploading piece. err: ecclient: upload failed (node:12bPDvhDfu8Z58LxZcicg1vAiiu1sZYGpwQnvuhk4t5m6yR87Fi, address:104.36.82.55:4201): protocol: write tcp 188.166.225.170:56302->104.36.82.55:4201: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:52.241392449 (84h40m1.963955499s) [seg_pos={0 0}, upload=81249]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Jul 28 00:15:52.467954056 (84h40m2.190517106s) [upload=81249]: Done uploading segments... Jul 28 00:15:52.467984765 (84h40m2.190547805s) [upload=81249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 1m0.229450765s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................X.X] duration: 30.234973806s FAIL (2025-07-28 00:15:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 4h38m49.468321249s) [noise=true , address=45.91.116.12:4225 , piece_id=7O4KTDOCFH2LH42FZN6UB56MO42UADU4VPZL3WV76ATOAIN3T4XQ, seg_pos={0 0}, upload=81244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: expected piece hash; context canceled; EOF Jul 28 00:14:39.745767448 (84h38m49.468330488s) [seg_pos={0 0}, upload=81244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:14:39.745916893 (84h38m49.468479933s) [upload=81244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:14:39.745921191 (84h38m49.468484231s) [upload=81244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:14:40.037599193 (84h38m49.760162233s) [upload=81244]: Done uploading segments... Jul 28 00:14:40.037615805 (84h38m49.760178845s) [upload=81244]: Upload finished. err: <nil> Jul 28 00:15:04.480798899 (84h39m14.20336194s) [upload=81252]: Starting upload Jul 28 00:15:04.480876769 (84h39m14.203439839s) [upload=81252]: Done starting upload Jul 28 00:15:04.481001578 (84h39m14.203564628s) [upload=81252]: Uploading segments... Jul 28 00:15:04.481081461 (84h39m14.203644501s) [upload=81252]: Got next segment. Inline: false Jul 28 00:15:04.481113221 (84h39m14.203676282s) [upload=81252]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:15:04.481119724 (84h39m14.203682764s) [upload=81252]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:15:04.716839411 (84h39m14.439402461s) [seg_pos={0 0}, upload=81252]: Begin upload segment... Jul 28 00:15:04.716900478 (84h39m14.439463528s) [seg_pos={0 0}, upload=81252]: Done begin upload segment. Jul 28 00:15:04.716928301 (84h39m14.439491351s) [noise=true , address=45.91.116.6:4973 , piece_id=Q4QGSWOSVLFAGBJVJ6MY3WBQSRVPUVGAKOBBWQXD2KTJWX7JXXNA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.716959711 (84h39m14.439522751s) [noise=true , address=45.91.116.7:4010 , piece_id=IDN2SM6QUYUYNTU4QZXULENX63SP3DE7YLOZ5V2XGFS7TPLZDD3A, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717364165 (84h39m14.439927205s) [noise=true , address=104.36.82.8:4970 , piece_id=OQBN2SMVR7DCWABX75PHXBVT2JFH4E336LQHXQDHYR5HXDNA6E4Q, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717377661 (84h39m14.439940701s) [noise=true , address=104.36.82.11:4113 , piece_id=7BSZUMUDAUNNYNVMVXFTOYD7CTWVSRCLCZGOMP3QJTE547M5HXVQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717621617 (84h39m14.440184658s) [noise=true , address=45.91.116.12:4226 , piece_id=XQYIJYMKLGOTI5NHR7TE7FW5P54KBQSIM5RVIS3JZUO5EBNGU7QQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717695910 (84h39m14.44025895s) [noise=true , address=45.91.116.6:4975 , piece_id=K2GNEYG5JIEDQXQNB7RYVK7UAWOZ3RTO3U3AZPGH6FLRUE3HISOQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.717898938 (84h39m14.440461978s) [noise=true , address=77.90.31.18:4807 , piece_id=SB2EOKTVXXPHDQQEHB4YJBBXLOXEBQN7KQSRBOVZP42ZGIUSIU7Q, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718043215 (84h39m14.440606255s) [noise=true , address=77.90.31.12:4592 , piece_id=LH4YNTF4IXLG3CVWSUIDXX2XTOEFMPCFEFD3RYST6IFO7VCGNBKQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718351064 (84h39m14.440914114s) [noise=true , address=45.91.116.10:4081 , piece_id=6ODMN4RNRD577D7Y2IW7VAQYWXSLUX4A2VDJRDRUTMSHAUNUSNZQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718650747 (84h39m14.441213787s) [noise=true , address=77.90.31.21:4877 , piece_id=6FMP75OPY5ROWCJKEDRKVTCONJ3GTHEQTYLQG2SPWEK7BWNIP5VQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.718948056 (84h39m14.441511096s) [noise=true , address=104.36.82.7:4911 , piece_id=JNMBXPYUEDWN3WNCQCQHR4B7DCIDDRX22GW57NEP543OWYYEWIZA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719239924 (84h39m14.441802974s) [noise=true , address=45.91.116.5:4299 , piece_id=DKCLRZ5J3GKZHBMK3IALNT35KH7XCMCLONPJDYP3YFAMXFK5E3CQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719543695 (84h39m14.442106735s) [noise=true , address=45.91.116.14:4189 , piece_id=7FBJZBG5CJDWWS4TGKJATJSSBLSPZXPRNOOPHIPYMLKPKTHYMTQQ, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.719846184 (84h39m14.442409224s) [noise=true , address=104.36.82.16:4293 , piece_id=ZWJUPUSTFIPB6FGUUWOOVIYXNCWPUF567DF6327BU76FW2EMYKNA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.720157299 (84h39m14.442720339s) [noise=true , address=45.91.116.4:4937 , piece_id=RTPEK3HBRIWLZNQRXNKFGD34GGBR5QX4FHYQUFOUJHN23XX2OZCA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:04.720484405 (84h39m14.443047455s) [noise=true , address=77.90.31.13:4627 , piece_id=7OTR55UTQONXNMRT5LM43BN7W5HYH5KHCLSSMOHU33AF2YJ4JUCA, seg_pos={0 0}, upload=81252]: Uploading piece... Jul 28 00:15:06.449685788 (84h39m16.172248828s) [upload=81252]: Next returned nil segment Jul 28 00:15:06.449705004 (84h39m16.172268084s) [upload=81252]: Waiting for error group managing segments... Jul 28 00:15:06.740940750 (84h39m16.46350378s) [noise=true , address=77.90.31.18:4807 , piece_id=SB2EOKTVXXPHDQQEHB4YJBBXLOXEBQN7KQSRBOVZP42ZGIUSIU7Q, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.741446858 (84h39m16.464009898s) [noise=true , address=77.90.31.12:4592 , piece_id=LH4YNTF4IXLG3CVWSUIDXX2XTOEFMPCFEFD3RYST6IFO7VCGNBKQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.747334472 (84h39m16.469897542s) [noise=true , address=45.91.116.6:4973 , piece_id=Q4QGSWOSVLFAGBJVJ6MY3WBQSRVPUVGAKOBBWQXD2KTJWX7JXXNA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.748805717 (84h39m16.471368747s) [noise=true , address=45.91.116.10:4081 , piece_id=6ODMN4RNRD577D7Y2IW7VAQYWXSLUX4A2VDJRDRUTMSHAUNUSNZQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.815890697 (84h39m16.538453737s) [noise=true , address=45.91.116.4:4937 , piece_id=RTPEK3HBRIWLZNQRXNKFGD34GGBR5QX4FHYQUFOUJHN23XX2OZCA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.819563003 (84h39m16.542126043s) [noise=true , address=77.90.31.21:4877 , piece_id=6FMP75OPY5ROWCJKEDRKVTCONJ3GTHEQTYLQG2SPWEK7BWNIP5VQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.830587626 (84h39m16.553150666s) [noise=true , address=45.91.116.5:4299 , piece_id=DKCLRZ5J3GKZHBMK3IALNT35KH7XCMCLONPJDYP3YFAMXFK5E3CQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.842458518 (84h39m16.565021558s) [noise=true , address=77.90.31.13:4627 , piece_id=7OTR55UTQONXNMRT5LM43BN7W5HYH5KHCLSSMOHU33AF2YJ4JUCA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.846136164 (84h39m16.568699204s) [noise=true , address=45.91.116.6:4975 , piece_id=K2GNEYG5JIEDQXQNB7RYVK7UAWOZ3RTO3U3AZPGH6FLRUE3HISOQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.857847821 (84h39m16.580410861s) [noise=true , address=45.91.116.14:4189 , piece_id=7FBJZBG5CJDWWS4TGKJATJSSBLSPZXPRNOOPHIPYMLKPKTHYMTQQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.892512974 (84h39m16.615076035s) [noise=true , address=45.91.116.7:4010 , piece_id=IDN2SM6QUYUYNTU4QZXULENX63SP3DE7YLOZ5V2XGFS7TPLZDD3A, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:06.898154658 (84h39m16.620717729s) [noise=true , address=45.91.116.12:4226 , piece_id=XQYIJYMKLGOTI5NHR7TE7FW5P54KBQSIM5RVIS3JZUO5EBNGU7QQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: <nil> Jul 28 00:15:33.823200918 (84h39m43.545763958s) [noise=true , address=104.36.82.16:4293 , piece_id=ZWJUPUSTFIPB6FGUUWOOVIYXNCWPUF567DF6327BU76FW2EMYKNA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: rpc: dial tcp 104.36.82.16:4293: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823269078 (84h39m43.545832118s) [noise=true , address=104.36.82.8:4970 , piece_id=OQBN2SMVR7DCWABX75PHXBVT2JFH4E336LQHXQDHYR5HXDNA6E4Q, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:104.36.82.8:4970): protocol: rpc: dial tcp 104.36.82.8:4970: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823301911 (84h39m43.545864951s) [noise=true , address=104.36.82.7:4911 , piece_id=JNMBXPYUEDWN3WNCQCQHR4B7DCIDDRX22GW57NEP543OWYYEWIZA, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:104.36.82.7:4911): protocol: rpc: dial tcp 104.36.82.7:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823310658 (84h39m43.545873728s) [noise=true , address=104.36.82.11:4113 , piece_id=7BSZUMUDAUNNYNVMVXFTOYD7CTWVSRCLCZGOMP3QJTE547M5HXVQ, seg_pos={0 0}, upload=81252]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: write tcp 188.166.225.170:41026->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:15:33.823344703 (84h39m43.545907743s) [seg_pos={0 0}, upload=81252]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 28 00:15:34.056565111 (84h39m43.779128151s) [upload=81252]: Done uploading segments... Jul 28 00:15:34.056591671 (84h39m43.779154711s) [upload=81252]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.23499723s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.......................................X............X......] duration: 1.916787595s FAIL (2025-07-28 00:15:28 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.916814297s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.878546525s FAIL (2025-07-28 00:15:19 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.878568186s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [..................................................X...XXXXXX] duration: 1m0.232662726s FAIL (2025-07-28 00:14:51 UTC) orbiter warning: ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== dress=104.36.82.15:4272 , piece_id=ATORNVQOPR2HQKXDUK4HTSM6T63XI4HPQ4MKPGDNCQNF2OYB72OQ, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.862313504 (84h38m2.584876545s) [noise=true , address=104.36.82.45:4931 , piece_id=LGPKF5KPJTFQA3XEWAHKINOJVIUPO3EPFNPFMRQTJBPE3C5BJ5NQ, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.862589813 (84h38m2.585152853s) [noise=true , address=104.36.82.20:4459 , piece_id=BHOSANJUYPWEJ3ZFURC3SYLWLFDTCPJADGUFV2WHAMZ7VKODXUVQ, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.862877784 (84h38m2.585440814s) [noise=true , address=104.36.82.3:4780 , piece_id=7FHRJKC6CA7L7TYFP2Y3JGQIGLXLQNYCAZ2ISAHOOXOKVNHGZKPA, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.863136730 (84h38m2.58569977s) [noise=true , address=104.36.82.34:4570 , piece_id=K65XDI4VBHLTVZIHIDNLBKLDHI7PHOGJQKTWV6NCVVBV5XC4BOGA, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.863389633 (84h38m2.585952673s) [noise=true , address=104.36.82.52:4106 , piece_id=YVYHK7B2REVZKQRL36M5TRVUVVFKTK72YJGZXQ6Q3FLSE5BRTIVQ, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.863655061 (84h38m2.586218102s) [noise=true , address=104.36.82.12:4155 , piece_id=4QEV4D7WNE7GMRIXL54LNE3VMBDEKNGELIKOJ7V7335UGS6P622Q, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.863889399 (84h38m2.586452439s) [noise=true , address=104.36.82.42:4826 , piece_id=7SLWMPYIFWXV3MM4BCG4L7LCT5GEQZOUNYWUZ3M2NPX37QRQHWHA, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:13:52.864083921 (84h38m2.586646951s) [noise=true , address=104.36.82.16:4316 , piece_id=JCFIK5GKUG4D2L3BOFE43SG7WVDUJ5O2S6IRZQWQBS7TIMIFXYOQ, seg_pos={0 0}, upload=81230]: Uploading piece... Jul 28 00:14:51.766579194 (84h39m1.489142234s) [upload=81230]: Next segment err: context deadline exceeded Jul 28 00:14:51.768167593 (84h39m1.490730633s) [noise=true , address=104.36.82.42:4826 , piece_id=7SLWMPYIFWXV3MM4BCG4L7LCT5GEQZOUNYWUZ3M2NPX37QRQHWHA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:13KQwy5RDTnWanKbCdnsdqRt88m58bEqcLmT3SpLxYW2uANXGv, address:104.36.82.42:4826): protocol: rpc: dial tcp 104.36.82.42:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768207530 (84h39m1.49077056s) [noise=true , address=104.36.82.49:4978 , piece_id=GZF33LD6THFYRSDEXMQRGA4I4CWVM2MHBUVLW37NFVEQ5YZTGZRA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:12PcGHVSm5UAXPh5vCfyRHCd7Bdb67oXF51AZcnRFUjXqVYzXLR, address:104.36.82.49:4978): protocol: rpc: dial tcp 104.36.82.49:4978: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768246414 (84h39m1.490809454s) [noise=true , address=104.36.82.56:4247 , piece_id=LNUPJNA3AGPNN33CGMTVNEFWGQPDZETYFGRDERB76GE3JBIEK5BA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:12PzKreuPT9X594ZTTYbXanNdaFVVJsnKL99fumjXymnRa9jeEq, address:104.36.82.56:4247): protocol: rpc: dial tcp 104.36.82.56:4247: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768302802 (84h39m1.490865842s) [noise=true , address=104.36.82.16:4316 , piece_id=JCFIK5GKUG4D2L3BOFE43SG7WVDUJ5O2S6IRZQWQBS7TIMIFXYOQ, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf, address:104.36.82.16:4316): protocol: rpc: dial tcp 104.36.82.16:4316: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768414616 (84h39m1.490977656s) [noise=true , address=104.36.82.3:4780 , piece_id=7FHRJKC6CA7L7TYFP2Y3JGQIGLXLQNYCAZ2ISAHOOXOKVNHGZKPA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM, address:104.36.82.3:4780): protocol: rpc: dial tcp 104.36.82.3:4780: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768459733 (84h39m1.491022773s) [noise=true , address=104.36.82.40:4941 , piece_id=3NYJS4FLTD64SN7PRYPFZ2O7I2AXG7NS42XAGIMBJOLQUFVHVS3Q, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:104.36.82.40:4941): protocol: rpc: dial tcp 104.36.82.40:4941: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768491102 (84h39m1.491054143s) [noise=true , address=104.36.82.54:4183 , piece_id=3IGP5HITYYUZTT54PLKVJGB776M55IJYHIKAU5VRWUKU5SVCEBFA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1kovWN9SiUhcGQtZitjH9zgPj7iHaZwY5v37bjwPvArmgX44jA, address:104.36.82.54:4183): protocol: rpc: dial tcp 104.36.82.54:4183: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768518735 (84h39m1.491081765s) [noise=true , address=104.36.82.15:4272 , piece_id=ATORNVQOPR2HQKXDUK4HTSM6T63XI4HPQ4MKPGDNCQNF2OYB72OQ, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1UeKsX3pQfhvCukBvJf1sekK7N6sXkaWaJnZzETKoxyXWo2BFi, address:104.36.82.15:4272): protocol: rpc: dial tcp 104.36.82.15:4272: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768549444 (84h39m1.491112484s) [noise=true , address=104.36.82.20:4459 , piece_id=BHOSANJUYPWEJ3ZFURC3SYLWLFDTCPJADGUFV2WHAMZ7VKODXUVQ, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1hpq5G467oUtEaE6Cj842pHCCZ1V7EraP5EDdGdWMxz4M3Q3pA, address:104.36.82.20:4459): protocol: rpc: dial tcp 104.36.82.20:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768576315 (84h39m1.491139355s) [noise=true , address=104.36.82.52:4106 , piece_id=YVYHK7B2REVZKQRL36M5TRVUVVFKTK72YJGZXQ6Q3FLSE5BRTIVQ, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:12E2hMuAUbJyh5F4yey1EtRLYhzr29wxs47qY3zGxmGvFNUctk2, address:104.36.82.52:4106): protocol: rpc: dial tcp 104.36.82.52:4106: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768617415 (84h39m1.491180455s) [noise=true , address=104.36.82.12:4155 , piece_id=4QEV4D7WNE7GMRIXL54LNE3VMBDEKNGELIKOJ7V7335UGS6P622Q, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1yiUBiCEpAs5yDmgVfFGuxgW4R53jzMJugo8Piff3p79EEZdWr, address:104.36.82.12:4155): protocol: rpc: dial tcp 104.36.82.12:4155: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768646751 (84h39m1.491209791s) [noise=true , address=104.36.82.34:4570 , piece_id=K65XDI4VBHLTVZIHIDNLBKLDHI7PHOGJQKTWV6NCVVBV5XC4BOGA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:12FX9wGFEYh96uNsKZLGCNRvEGLCmSmcG8a5HxU67yUU6eT1W4f, address:104.36.82.34:4570): protocol: rpc: dial tcp 104.36.82.34:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768673532 (84h39m1.491236572s) [noise=true , address=104.36.82.4:4807 , piece_id=Q77HUDQ5USUNQBRZ7M4EEJIOHDQE6ZND2MRYAZD5TPCOH75MX5PA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1MZ9LJLHF4XXvmRG2r7XkanDfdNSKCUgua9EBPusPuGyLzTLo8, address:104.36.82.4:4807): protocol: rpc: dial tcp 104.36.82.4:4807: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768707727 (84h39m1.491270767s) [noise=true , address=104.36.82.10:4094 , piece_id=XX5DTHANKBQCZRUTG3ODR5F66EAYI5EVKEKXR24N2GL65BAONXHQ, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: rpc: dial tcp 104.36.82.10:4094: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768749697 (84h39m1.491312737s) [noise=true , address=104.36.82.55:4200 , piece_id=PEGRYWJI3I7YMXX3IAS2S3MR6A4ATWTQAZ2G4QSOZPGI46DU24PA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1Y936LLJepKpXAF6huSDRd61pWHNmdntRVNZutbadfeaZerMyj, address:104.36.82.55:4200): protocol: rpc: dial tcp 104.36.82.55:4200: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768781047 (84h39m1.491344087s) [noise=true , address=104.36.82.5:4842 , piece_id=OGG3HNTIGP3PZZCQJXTZTBTFS3D5ATRB3HMGOCWJQCWZ3U3C4LWA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn, address:104.36.82.5:4842): protocol: rpc: dial tcp 104.36.82.5:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768818800 (84h39m1.49138184s) [noise=true , address=104.36.82.46:4514 , piece_id=LXAOL43JK64VTL72UO5IBKJHMCGRTGUABOSPXHPXYAK7KPANRMNA, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:1iJgoxnaKnevARfWPAkd6ygyKXHZeVH8BvJPH13zbev6mGw2Bk, address:104.36.82.46:4514): protocol: rpc: dial tcp 104.36.82.46:4514: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768851492 (84h39m1.491414532s) [noise=true , address=104.36.82.45:4931 , piece_id=LGPKF5KPJTFQA3XEWAHKINOJVIUPO3EPFNPFMRQTJBPE3C5BJ5NQ, seg_pos={0 0}, upload=81230]: Done uploading piece. err: ecclient: upload failed (node:12pCgoSfxjtXPw5jpbz9RJaxRiGoYPdPFdoMPtD19F1ZWY8UwPu, address:104.36.82.45:4931): protocol: write tcp 188.166.225.170:43064->104.36.82.45:4931: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:51.768861521 (84h39m1.491424561s) [seg_pos={0 0}, upload=81230]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m0.232681782s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.814374854s FAIL (2025-07-28 00:14:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== onn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:02.541185363 (84h37m12.263748413s) [seg_pos={0 0}, upload=81217]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:13:02.541379915 (84h37m12.263942965s) [upload=81217]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:13:02.541387379 (84h37m12.263950429s) [upload=81217]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:13:02.842765569 (84h37m12.565328619s) [upload=81217]: Done uploading segments... Jul 28 00:13:02.842818560 (84h37m12.565381611s) [upload=81217]: Upload finished. err: <nil> Jul 28 00:14:06.832083031 (84h38m16.554646071s) [upload=81234]: Starting upload Jul 28 00:14:06.832143917 (84h38m16.554706957s) [upload=81234]: Done starting upload Jul 28 00:14:06.832192500 (84h38m16.55475554s) [upload=81234]: Uploading segments... Jul 28 00:14:06.832308402 (84h38m16.554871432s) [upload=81234]: Got next segment. Inline: false Jul 28 00:14:06.832332729 (84h38m16.554895769s) [upload=81234]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:14:06.832379038 (84h38m16.554942078s) [upload=81234]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:14:07.069638894 (84h38m16.792201934s) [seg_pos={0 0}, upload=81234]: Begin upload segment... Jul 28 00:14:07.069780064 (84h38m16.792343114s) [seg_pos={0 0}, upload=81234]: Done begin upload segment. Jul 28 00:14:07.069815833 (84h38m16.792378863s) [noise=true , address=45.91.116.14:4191 , piece_id=EWZQOAGO2HJIOHAGPWO4I5KZYMYDH6KEWIWH7OJYZU7X6QX2PJRA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.069823998 (84h38m16.792387028s) [noise=true , address=104.36.82.16:4293 , piece_id=S44IV2VXPTE2T2S3UJZXJDXS3KF2P73RVRDK6MKQ7LXHFKY7UDQQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.070154851 (84h38m16.792717891s) [noise=true , address=104.36.82.13:4186 , piece_id=SJZEBXVKECXJLBRIFQ6XJ2J3YJFXZPBNPRA426DLEALYD2U5ZIQA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.070406503 (84h38m16.792969543s) [noise=true , address=45.91.116.6:4973 , piece_id=6O6O4FJA7KJ4YCGZZUJFTJTXSGEDC5NGJKP5VD354Z3ATBXGWJJA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.070667613 (84h38m16.793230653s) [noise=true , address=104.36.82.4:4802 , piece_id=ETDF7XUCA2IDDPZXPQIEUJMDJSCCLDBB277HC4NB74I5DWRETDKQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071031479 (84h38m16.793594529s) [noise=true , address=45.91.116.13:4154 , piece_id=MMSBZ6S6KNGT466PK3JDFAYECE2HKAKI2C2XHUHXNMD46HEGDDTQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071287899 (84h38m16.793850939s) [noise=true , address=45.91.116.9:4263 , piece_id=BF625DXSIWXKOS6M52PYDGLXLBGL7PVQV3XJ7XPZVGZ6FPXNQVPQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071502440 (84h38m16.79406548s) [noise=true , address=45.91.116.12:4226 , piece_id=IOROHEXTPBROJPQF7HX7PHV3I4VIH5BGZ7V4MEMZAXHK6TIWJXCA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071694066 (84h38m16.794257106s) [noise=true , address=77.90.31.12:4589 , piece_id=IY2OWMCRRSCLIMNRLRHWZYZMNYHJAKMDJB55CDPZQCRGAIAILDQA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071994812 (84h38m16.794557862s) [noise=true , address=45.91.116.12:4225 , piece_id=7UQPLI645A4SJWMWEQRBKH2252N4VLJTBGGK3XQ76YCHPE4GGDTQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.072908810 (84h38m16.79547185s) [noise=true , address=77.90.31.16:4735 , piece_id=ZMU734HSUQRZBQUSXLCYWF7W4GTTB7NXUFETODPFEVFWYVZFQ6EA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.072928679 (84h38m16.795491719s) [noise=true , address=45.91.116.10:4083 , piece_id=ZJHTDAEM23LGFK4EK4D3P6S5PMSKHGURLOQ23NR6W6TFCYTDBISA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.073356907 (84h38m16.795919948s) [noise=true , address=77.90.31.10:4518 , piece_id=UQH55LUAWYR5NSVRXXE2LBVJUZQOPRHEDUH2S6E4OY63W5KRYRUQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.073973647 (84h38m16.796536687s) [noise=true , address=104.36.82.8:4972 , piece_id=FGHWAMXGXDSFD7Y7NHC3LLEYVOLDGH725HY27RBQR5WC2JSEZ3HA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.074190893 (84h38m16.796753933s) [noise=true , address=77.90.31.19:4842 , piece_id=6O5K5OL3PZ6DHQG2OTEB3DEJJPJSKPVLX2YPAFKZNJIHRVAZHRZA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.074611729 (84h38m16.797174769s) [noise=true , address=104.36.82.5:4840 , piece_id=SWGYOU5A43UT2YEOEG2CS2TDHLGB5PCBC663AQH2D75VV4CHY2TQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:08.828150913 (84h38m18.550713954s) [upload=81234]: Next returned nil segment Jul 28 00:14:08.828193245 (84h38m18.550756285s) [upload=81234]: Waiting for error group managing segments... Jul 28 00:14:09.105320036 (84h38m18.827883076s) [noise=true , address=45.91.116.9:4263 , piece_id=BF625DXSIWXKOS6M52PYDGLXLBGL7PVQV3XJ7XPZVGZ6FPXNQVPQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.106907042 (84h38m18.829470082s) [noise=true , address=77.90.31.12:4589 , piece_id=IY2OWMCRRSCLIMNRLRHWZYZMNYHJAKMDJB55CDPZQCRGAIAILDQA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.149925576 (84h38m18.872488617s) [noise=true , address=45.91.116.13:4154 , piece_id=MMSBZ6S6KNGT466PK3JDFAYECE2HKAKI2C2XHUHXNMD46HEGDDTQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.161168177 (84h38m18.883731237s) [noise=true , address=45.91.116.14:4191 , piece_id=EWZQOAGO2HJIOHAGPWO4I5KZYMYDH6KEWIWH7OJYZU7X6QX2PJRA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.201783955 (84h38m18.924346995s) [noise=true , address=77.90.31.10:4518 , piece_id=UQH55LUAWYR5NSVRXXE2LBVJUZQOPRHEDUH2S6E4OY63W5KRYRUQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.206134097 (84h38m18.928697137s) [noise=true , address=45.91.116.12:4226 , piece_id=IOROHEXTPBROJPQF7HX7PHV3I4VIH5BGZ7V4MEMZAXHK6TIWJXCA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.211591940 (84h38m18.93415498s) [noise=true , address=77.90.31.19:4842 , piece_id=6O5K5OL3PZ6DHQG2OTEB3DEJJPJSKPVLX2YPAFKZNJIHRVAZHRZA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.214527045 (84h38m18.937090085s) [noise=true , address=45.91.116.6:4973 , piece_id=6O6O4FJA7KJ4YCGZZUJFTJTXSGEDC5NGJKP5VD354Z3ATBXGWJJA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.243601201 (84h38m18.966164241s) [noise=true , address=45.91.116.12:4225 , piece_id=7UQPLI645A4SJWMWEQRBKH2252N4VLJTBGGK3XQ76YCHPE4GGDTQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.273963521 (84h38m18.996526561s) [noise=true , address=45.91.116.10:4083 , piece_id=ZJHTDAEM23LGFK4EK4D3P6S5PMSKHGURLOQ23NR6W6TFCYTDBISA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.362915428 (84h38m19.085478468s) [noise=true , address=77.90.31.16:4735 , piece_id=ZMU734HSUQRZBQUSXLCYWF7W4GTTB7NXUFETODPFEVFWYVZFQ6EA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:36.188618657 (84h38m45.911181697s) [noise=true , address=104.36.82.16:4293 , piece_id=S44IV2VXPTE2T2S3UJZXJDXS3KF2P73RVRDK6MKQ7LXHFKY7UDQQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: write tcp 188.166.225.170:52528->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188649606 (84h38m45.911212636s) [noise=true , address=104.36.82.13:4186 , piece_id=SJZEBXVKECXJLBRIFQ6XJ2J3YJFXZPBNPRA426DLEALYD2U5ZIQA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:104.36.82.13:4186): protocol: rpc: dial tcp 104.36.82.13:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188682589 (84h38m45.911245629s) [noise=true , address=104.36.82.4:4802 , piece_id=ETDF7XUCA2IDDPZXPQIEUJMDJSCCLDBB277HC4NB74I5DWRETDKQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:104.36.82.4:4802): protocol: write tcp 188.166.225.170:42434->104.36.82.4:4802: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188688210 (84h38m45.91125125s) [noise=true , address=104.36.82.8:4972 , piece_id=FGHWAMXGXDSFD7Y7NHC3LLEYVOLDGH725HY27RBQR5WC2JSEZ3HA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:104.36.82.8:4972): protocol: rpc: dial tcp 104.36.82.8:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188693100 (84h38m45.91125614s) [noise=true , address=104.36.82.5:4840 , piece_id=SWGYOU5A43UT2YEOEG2CS2TDHLGB5PCBC663AQH2D75VV4CHY2TQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:104.36.82.5:4840): protocol: write tcp 188.166.225.170:42966->104.36.82.5:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188706796 (84h38m45.911269836s) [seg_pos={0 0}, upload=81234]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 28 00:14:36.418121040 (84h38m46.140684091s) [upload=81234]: Done uploading segments... Jul 28 00:14:36.418151450 (84h38m46.14071449s) [upload=81234]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.814391485s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.231801362s FAIL (2025-07-28 00:14:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== onn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:02.541185363 (84h37m12.263748413s) [seg_pos={0 0}, upload=81217]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:13:02.541379915 (84h37m12.263942965s) [upload=81217]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:13:02.541387379 (84h37m12.263950429s) [upload=81217]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:13:02.842765569 (84h37m12.565328619s) [upload=81217]: Done uploading segments... Jul 28 00:13:02.842818560 (84h37m12.565381611s) [upload=81217]: Upload finished. err: <nil> Jul 28 00:14:06.832083031 (84h38m16.554646071s) [upload=81234]: Starting upload Jul 28 00:14:06.832143917 (84h38m16.554706957s) [upload=81234]: Done starting upload Jul 28 00:14:06.832192500 (84h38m16.55475554s) [upload=81234]: Uploading segments... Jul 28 00:14:06.832308402 (84h38m16.554871432s) [upload=81234]: Got next segment. Inline: false Jul 28 00:14:06.832332729 (84h38m16.554895769s) [upload=81234]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:14:06.832379038 (84h38m16.554942078s) [upload=81234]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:14:07.069638894 (84h38m16.792201934s) [seg_pos={0 0}, upload=81234]: Begin upload segment... Jul 28 00:14:07.069780064 (84h38m16.792343114s) [seg_pos={0 0}, upload=81234]: Done begin upload segment. Jul 28 00:14:07.069815833 (84h38m16.792378863s) [noise=true , address=45.91.116.14:4191 , piece_id=EWZQOAGO2HJIOHAGPWO4I5KZYMYDH6KEWIWH7OJYZU7X6QX2PJRA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.069823998 (84h38m16.792387028s) [noise=true , address=104.36.82.16:4293 , piece_id=S44IV2VXPTE2T2S3UJZXJDXS3KF2P73RVRDK6MKQ7LXHFKY7UDQQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.070154851 (84h38m16.792717891s) [noise=true , address=104.36.82.13:4186 , piece_id=SJZEBXVKECXJLBRIFQ6XJ2J3YJFXZPBNPRA426DLEALYD2U5ZIQA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.070406503 (84h38m16.792969543s) [noise=true , address=45.91.116.6:4973 , piece_id=6O6O4FJA7KJ4YCGZZUJFTJTXSGEDC5NGJKP5VD354Z3ATBXGWJJA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.070667613 (84h38m16.793230653s) [noise=true , address=104.36.82.4:4802 , piece_id=ETDF7XUCA2IDDPZXPQIEUJMDJSCCLDBB277HC4NB74I5DWRETDKQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071031479 (84h38m16.793594529s) [noise=true , address=45.91.116.13:4154 , piece_id=MMSBZ6S6KNGT466PK3JDFAYECE2HKAKI2C2XHUHXNMD46HEGDDTQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071287899 (84h38m16.793850939s) [noise=true , address=45.91.116.9:4263 , piece_id=BF625DXSIWXKOS6M52PYDGLXLBGL7PVQV3XJ7XPZVGZ6FPXNQVPQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071502440 (84h38m16.79406548s) [noise=true , address=45.91.116.12:4226 , piece_id=IOROHEXTPBROJPQF7HX7PHV3I4VIH5BGZ7V4MEMZAXHK6TIWJXCA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071694066 (84h38m16.794257106s) [noise=true , address=77.90.31.12:4589 , piece_id=IY2OWMCRRSCLIMNRLRHWZYZMNYHJAKMDJB55CDPZQCRGAIAILDQA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.071994812 (84h38m16.794557862s) [noise=true , address=45.91.116.12:4225 , piece_id=7UQPLI645A4SJWMWEQRBKH2252N4VLJTBGGK3XQ76YCHPE4GGDTQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.072908810 (84h38m16.79547185s) [noise=true , address=77.90.31.16:4735 , piece_id=ZMU734HSUQRZBQUSXLCYWF7W4GTTB7NXUFETODPFEVFWYVZFQ6EA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.072928679 (84h38m16.795491719s) [noise=true , address=45.91.116.10:4083 , piece_id=ZJHTDAEM23LGFK4EK4D3P6S5PMSKHGURLOQ23NR6W6TFCYTDBISA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.073356907 (84h38m16.795919948s) [noise=true , address=77.90.31.10:4518 , piece_id=UQH55LUAWYR5NSVRXXE2LBVJUZQOPRHEDUH2S6E4OY63W5KRYRUQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.073973647 (84h38m16.796536687s) [noise=true , address=104.36.82.8:4972 , piece_id=FGHWAMXGXDSFD7Y7NHC3LLEYVOLDGH725HY27RBQR5WC2JSEZ3HA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.074190893 (84h38m16.796753933s) [noise=true , address=77.90.31.19:4842 , piece_id=6O5K5OL3PZ6DHQG2OTEB3DEJJPJSKPVLX2YPAFKZNJIHRVAZHRZA, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:07.074611729 (84h38m16.797174769s) [noise=true , address=104.36.82.5:4840 , piece_id=SWGYOU5A43UT2YEOEG2CS2TDHLGB5PCBC663AQH2D75VV4CHY2TQ, seg_pos={0 0}, upload=81234]: Uploading piece... Jul 28 00:14:08.828150913 (84h38m18.550713954s) [upload=81234]: Next returned nil segment Jul 28 00:14:08.828193245 (84h38m18.550756285s) [upload=81234]: Waiting for error group managing segments... Jul 28 00:14:09.105320036 (84h38m18.827883076s) [noise=true , address=45.91.116.9:4263 , piece_id=BF625DXSIWXKOS6M52PYDGLXLBGL7PVQV3XJ7XPZVGZ6FPXNQVPQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.106907042 (84h38m18.829470082s) [noise=true , address=77.90.31.12:4589 , piece_id=IY2OWMCRRSCLIMNRLRHWZYZMNYHJAKMDJB55CDPZQCRGAIAILDQA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.149925576 (84h38m18.872488617s) [noise=true , address=45.91.116.13:4154 , piece_id=MMSBZ6S6KNGT466PK3JDFAYECE2HKAKI2C2XHUHXNMD46HEGDDTQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.161168177 (84h38m18.883731237s) [noise=true , address=45.91.116.14:4191 , piece_id=EWZQOAGO2HJIOHAGPWO4I5KZYMYDH6KEWIWH7OJYZU7X6QX2PJRA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.201783955 (84h38m18.924346995s) [noise=true , address=77.90.31.10:4518 , piece_id=UQH55LUAWYR5NSVRXXE2LBVJUZQOPRHEDUH2S6E4OY63W5KRYRUQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.206134097 (84h38m18.928697137s) [noise=true , address=45.91.116.12:4226 , piece_id=IOROHEXTPBROJPQF7HX7PHV3I4VIH5BGZ7V4MEMZAXHK6TIWJXCA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.211591940 (84h38m18.93415498s) [noise=true , address=77.90.31.19:4842 , piece_id=6O5K5OL3PZ6DHQG2OTEB3DEJJPJSKPVLX2YPAFKZNJIHRVAZHRZA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.214527045 (84h38m18.937090085s) [noise=true , address=45.91.116.6:4973 , piece_id=6O6O4FJA7KJ4YCGZZUJFTJTXSGEDC5NGJKP5VD354Z3ATBXGWJJA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.243601201 (84h38m18.966164241s) [noise=true , address=45.91.116.12:4225 , piece_id=7UQPLI645A4SJWMWEQRBKH2252N4VLJTBGGK3XQ76YCHPE4GGDTQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.273963521 (84h38m18.996526561s) [noise=true , address=45.91.116.10:4083 , piece_id=ZJHTDAEM23LGFK4EK4D3P6S5PMSKHGURLOQ23NR6W6TFCYTDBISA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:09.362915428 (84h38m19.085478468s) [noise=true , address=77.90.31.16:4735 , piece_id=ZMU734HSUQRZBQUSXLCYWF7W4GTTB7NXUFETODPFEVFWYVZFQ6EA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: <nil> Jul 28 00:14:36.188618657 (84h38m45.911181697s) [noise=true , address=104.36.82.16:4293 , piece_id=S44IV2VXPTE2T2S3UJZXJDXS3KF2P73RVRDK6MKQ7LXHFKY7UDQQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: write tcp 188.166.225.170:52528->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188649606 (84h38m45.911212636s) [noise=true , address=104.36.82.13:4186 , piece_id=SJZEBXVKECXJLBRIFQ6XJ2J3YJFXZPBNPRA426DLEALYD2U5ZIQA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:104.36.82.13:4186): protocol: rpc: dial tcp 104.36.82.13:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188682589 (84h38m45.911245629s) [noise=true , address=104.36.82.4:4802 , piece_id=ETDF7XUCA2IDDPZXPQIEUJMDJSCCLDBB277HC4NB74I5DWRETDKQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:104.36.82.4:4802): protocol: write tcp 188.166.225.170:42434->104.36.82.4:4802: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188688210 (84h38m45.91125125s) [noise=true , address=104.36.82.8:4972 , piece_id=FGHWAMXGXDSFD7Y7NHC3LLEYVOLDGH725HY27RBQR5WC2JSEZ3HA, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:104.36.82.8:4972): protocol: rpc: dial tcp 104.36.82.8:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188693100 (84h38m45.91125614s) [noise=true , address=104.36.82.5:4840 , piece_id=SWGYOU5A43UT2YEOEG2CS2TDHLGB5PCBC663AQH2D75VV4CHY2TQ, seg_pos={0 0}, upload=81234]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:104.36.82.5:4840): protocol: write tcp 188.166.225.170:42966->104.36.82.5:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:36.188706796 (84h38m45.911269836s) [seg_pos={0 0}, upload=81234]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 28 00:14:36.418121040 (84h38m46.140684091s) [upload=81234]: Done uploading segments... Jul 28 00:14:36.418151450 (84h38m46.14071449s) [upload=81234]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.231824124s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.724254749s FAIL (2025-07-28 00:14:34 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.72428099s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.......................................X............X.....] duration: 1.986556524s FAIL (2025-07-28 00:14:29 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.986582274s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X.......................................X............X....] duration: 2.062455307s FAIL (2025-07-28 00:14:05 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 2.062481097s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [...................................................X...XXXXX] duration: 1m0.233484954s FAIL (2025-07-28 00:13:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== ) [noise=true , address=104.36.82.55:4210 , piece_id=SJGNL4EHXHVYOCBQJ7IKFKTFD7VCLV4AXC7RKBTKIUU3YJUYG5SQ, seg_pos={0 0}, upload=81215]: Uploading piece... Jul 28 00:12:44.859711355 (84h36m54.582274395s) [noise=true , address=104.36.82.5:4859 , piece_id=ZRQ5JZUGPOA6VVWCU4SBQZFFTVDSUSIQZ7ZMMQ6JEBGMBDOK5FUQ, seg_pos={0 0}, upload=81215]: Uploading piece... Jul 28 00:12:44.859923941 (84h36m54.582486981s) [noise=true , address=104.36.82.55:4220 , piece_id=MZIPRJLZCQIQVQKBXZKZGDEJUBGGMRDYZIMHKYFFHC7UARABVSUQ, seg_pos={0 0}, upload=81215]: Uploading piece... Jul 28 00:12:44.861356453 (84h36m54.583919493s) [noise=true , address=104.36.82.42:4813 , piece_id=BDVUH5V5VONX3XOVGQAL2YCJOGA3SU77UVOLPAX7MQ7U5I22ZHVA, seg_pos={0 0}, upload=81215]: Uploading piece... Jul 28 00:12:44.861593386 (84h36m54.584156426s) [noise=true , address=104.36.82.13:4211 , piece_id=LEMBL5KIESNZ756A4SLLWOGBR2MPINI5ARTEOW5A53VCJG2RNPEA, seg_pos={0 0}, upload=81215]: Uploading piece... Jul 28 00:12:44.861849255 (84h36m54.584412295s) [noise=true , address=79.127.220.98:4404 , piece_id=FQ2WSKKLXKMLK6YWROLW6IQN7LPQRDFA7JQK6IXBPPG5AF5HZGLQ, seg_pos={0 0}, upload=81215]: Uploading piece... Jul 28 00:12:44.862108752 (84h36m54.584671792s) [noise=true , address=79.127.201.215:4359 , piece_id=YLHIPOQIJ54N63YRYWWCQOK7KUCY6NGXXPCMQAQKXNODW6M3NQYQ, seg_pos={0 0}, upload=81215]: Uploading piece... Jul 28 00:12:46.214784411 (84h36m55.937347451s) [upload=81215]: Next returned nil segment Jul 28 00:12:46.214802365 (84h36m55.937365395s) [upload=81215]: Waiting for error group managing segments... Jul 28 00:12:46.716382710 (84h36m56.43894575s) [noise=true , address=79.127.220.98:4404 , piece_id=FQ2WSKKLXKMLK6YWROLW6IQN7LPQRDFA7JQK6IXBPPG5AF5HZGLQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: <nil> Jul 28 00:12:46.805452172 (84h36m56.528015213s) [noise=true , address=79.127.201.215:4359 , piece_id=YLHIPOQIJ54N63YRYWWCQOK7KUCY6NGXXPCMQAQKXNODW6M3NQYQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: <nil> Jul 28 00:13:43.766587954 (84h37m53.489150994s) [noise=true , address=104.36.82.50:4020 , piece_id=ZC2XYMUQA5BF5BRWJP5NVR6U4ZONOQTYMQ45ETFTKTLMTDHDSF3A, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:129LAxYoAkRhCwZLWqeTHSUUMnAQZTotqKyBr3vMTDKF9cEKNCk, address:104.36.82.50:4020): protocol: write tcp 188.166.225.170:47826->104.36.82.50:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766643010 (84h37m53.48920605s) [noise=true , address=104.36.82.52:4085 , piece_id=DV5YPK5W7E6BEGJPHZXBNLATNHQRUXGWQIF4RRY4JTQ7PNPCTKKA, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:104.36.82.52:4085): protocol: write tcp 188.166.225.170:48572->104.36.82.52:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766679439 (84h37m53.489242479s) [noise=true , address=104.36.82.5:4859 , piece_id=ZRQ5JZUGPOA6VVWCU4SBQZFFTVDSUSIQZ7ZMMQ6JEBGMBDOK5FUQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: rpc: dial tcp 104.36.82.5:4859: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766712322 (84h37m53.489275362s) [noise=true , address=104.36.82.3:4771 , piece_id=MJHFXHKQCSZDJC2DQU2TRNFEN5ADFDFKJYBCSGAUHCCH7JLCZCDA, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL, address:104.36.82.3:4771): protocol: write tcp 188.166.225.170:44058->104.36.82.3:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766745386 (84h37m53.489308426s) [noise=true , address=104.36.82.41:4775 , piece_id=Q2NX6BXPDITSCH5XSAVVHHLWOZYF3W2PG2PBLEEPMF6M5JBCMTBQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj, address:104.36.82.41:4775): protocol: write tcp 188.166.225.170:43222->104.36.82.41:4775: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766774491 (84h37m53.489337532s) [noise=true , address=104.36.82.14:4231 , piece_id=JUOGPDT2TDR5JXC5YSQGEE4TOXY45N6NI6T55JCEUAD4LMPQMEUQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ, address:104.36.82.14:4231): protocol: write tcp 188.166.225.170:60514->104.36.82.14:4231: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766805651 (84h37m53.489368691s) [noise=true , address=104.36.82.11:4140 , piece_id=5I6VSDKFGANPEZVJMOWNZJNQLZKOZPKRGTKCYANBLPESMDX5MPRA, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB, address:104.36.82.11:4140): protocol: write tcp 188.166.225.170:51798->104.36.82.11:4140: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766840497 (84h37m53.489403537s) [noise=true , address=104.36.82.55:4210 , piece_id=SJGNL4EHXHVYOCBQJ7IKFKTFD7VCLV4AXC7RKBTKIUU3YJUYG5SQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:12KuoSWvJCc3mfowPPSJkdCDewkrHZnG6gz1fWcmJRGR5wvHzLL, address:104.36.82.55:4210): protocol: write tcp 188.166.225.170:37270->104.36.82.55:4210: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766853022 (84h37m53.489416062s) [noise=true , address=104.36.82.53:4154 , piece_id=QJ4VPXO6VMZ45LUZPWOSIISYLKLGOC6AFWOS4IPBVUNI354N4KXA, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:1vbGunXCRMkmfvBqHPmbuW7fBLKck4Vh9MGsX1q7P6VfX6DKqB, address:104.36.82.53:4154): protocol: write tcp 188.166.225.170:46258->104.36.82.53:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766883069 (84h37m53.489446109s) [noise=true , address=104.36.82.55:4220 , piece_id=MZIPRJLZCQIQVQKBXZKZGDEJUBGGMRDYZIMHKYFFHC7UARABVSUQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:15jMrmLPcRL8VeYUPzYNPhc2N7qZt4QgTsrSHoo4Zrt4cGrHHK, address:104.36.82.55:4220): protocol: rpc: dial tcp 104.36.82.55:4220: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766913137 (84h37m53.489476207s) [noise=true , address=104.36.82.40:4975 , piece_id=4HKDNVUYF3TDPFBLOL2256EHNCTN4WXMNWEC5GCMAVVMC4UTQCWQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:1fUjYWso7fh5NoXn8jc9Pu8aukkP2PbPdtTKChfaQ8GiWtn1RV, address:104.36.82.40:4975): protocol: write tcp 188.166.225.170:58002->104.36.82.40:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766922745 (84h37m53.489485775s) [noise=true , address=104.36.82.42:4813 , piece_id=BDVUH5V5VONX3XOVGQAL2YCJOGA3SU77UVOLPAX7MQ7U5I22ZHVA, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6, address:104.36.82.42:4813): protocol: write tcp 188.166.225.170:44210->104.36.82.42:4813: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766959525 (84h37m53.489522555s) [noise=true , address=104.36.82.13:4211 , piece_id=LEMBL5KIESNZ756A4SLLWOGBR2MPINI5ARTEOW5A53VCJG2RNPEA, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:12dANoYTygpcpWfCcAJtsnVBFWSekLhDjheAXnsaYMChRYAm2qc, address:104.36.82.13:4211): protocol: rpc: dial tcp 104.36.82.13:4211: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766964535 (84h37m53.489527605s) [noise=true , address=104.36.82.20:4450 , piece_id=NNRJMRKMGL2EPDR7ZD4A3PLP2Y67HQNWIRJLKQAUEW3HYMQHC2QQ, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:12UeL1LySKQySa8wjvG4FBs69cE1iWkW4Diz83nu1PxBCKxyvki, address:104.36.82.20:4450): protocol: write tcp 188.166.225.170:37384->104.36.82.20:4450: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.766989111 (84h37m53.489552151s) [noise=true , address=104.36.82.54:4187 , piece_id=TWBFDL62I7CVNI7TDSCAH66FWN5JKILAGSJ54EIZDVSZFM5KPTTA, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF, address:104.36.82.54:4187): protocol: write tcp 188.166.225.170:48086->104.36.82.54:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.767001465 (84h37m53.489564506s) [noise=true , address=104.36.82.44:4904 , piece_id=DMZ7GELFROXJUYLMML4ABUUWDWGTWKIDWEMLHEKM6FSKOAOBYQ5A, seg_pos={0 0}, upload=81215]: Done uploading piece. err: ecclient: upload failed (node:1dC7mC2Cbxmys7ukEkELyF9Us7F1qtptSP6yDJh1EfjVJ6uqsC, address:104.36.82.44:4904): protocol: write tcp 188.166.225.170:33020->104.36.82.44:4904: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:43.767033296 (84h37m53.489596326s) [seg_pos={0 0}, upload=81215]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Jul 28 00:13:43.998323681 (84h37m53.720886731s) [upload=81215]: Done uploading segments... Jul 28 00:13:43.998357275 (84h37m53.720920316s) [upload=81215]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 1m0.233507256s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.749913645s FAIL (2025-07-28 00:13:27 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.749940466s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X.......................................X............X...] duration: 2.208255268s FAIL (2025-07-28 00:13:05 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 2.208286136s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [....................................................X...XXXX] duration: 1m0.24835735s FAIL (2025-07-28 00:12:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== , piece_id=UYBNJDRX3EXIEKH4GF2LXSWH5QD7LHZFYOPNAQZTL3IL426DF7YQ, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.325662567 (84h35m54.048225607s) [noise=true , address=104.36.82.13:4189 , piece_id=CAUOLXHDX2CWR5NDR53RHHWIQ6LH6QDVOPRN4EGSAM37UDPLUTZQ, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.326017496 (84h35m54.048580536s) [noise=true , address=104.36.82.51:4074 , piece_id=TQ7QAKXMAXOGRF46IKAMZ3VA6IWBJCTB6AFTUZRAG3CQ74HX5OUQ, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.326901968 (84h35m54.049465008s) [noise=true , address=79.127.201.215:4352 , piece_id=6KL7CJ47H6J72SCSBC5DDDLXHDSPNJ4W43XTBMBK2DW3COUC6NDQ, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.327571920 (84h35m54.050134961s) [noise=true , address=104.36.82.22:4533 , piece_id=TEAHFVPSGR6JASJLV6YZPVCS7EDL7YA5N2ZKUAGBKRELNVHQOQUA, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.328156308 (84h35m54.050719368s) [noise=true , address=104.36.82.10:4107 , piece_id=XPLJGM3XZVA7W2R4FJ6BF2DGQKZ653M3P7WWHZ6RSO5NLIRVHLUA, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.328822813 (84h35m54.051385863s) [noise=true , address=104.36.82.5:4859 , piece_id=DFNXPHR367TJQ54B2QHOEDCF6KL2NM7GMME5JFHHR7EC46IBHQPQ, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.329321818 (84h35m54.051884858s) [noise=true , address=104.36.82.50:4016 , piece_id=3TSXGIYBM4BGBK7MY6GWTLVVCFV4RBUDXLEPFJWS6UZB77FYDADQ, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:44.329762912 (84h35m54.052325952s) [noise=true , address=79.127.205.235:4682 , piece_id=3D56MFGYTYBYU5IO3YJZNH4CI3776SGLJY24XUE4V2YQLDKR2SMA, seg_pos={0 0}, upload=81199]: Uploading piece... Jul 28 00:11:45.435025990 (84h35m55.15758903s) [upload=81199]: Next returned nil segment Jul 28 00:11:45.435040607 (84h35m55.157603647s) [upload=81199]: Waiting for error group managing segments... Jul 28 00:11:45.714476126 (84h35m55.437039156s) [noise=true , address=79.127.205.235:4682 , piece_id=3D56MFGYTYBYU5IO3YJZNH4CI3776SGLJY24XUE4V2YQLDKR2SMA, seg_pos={0 0}, upload=81199]: Done uploading piece. err: <nil> Jul 28 00:11:46.325136137 (84h35m56.047699167s) [noise=true , address=79.127.201.215:4352 , piece_id=6KL7CJ47H6J72SCSBC5DDDLXHDSPNJ4W43XTBMBK2DW3COUC6NDQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: <nil> Jul 28 00:12:43.223228696 (84h36m52.945791736s) [noise=true , address=104.36.82.50:4016 , piece_id=3TSXGIYBM4BGBK7MY6GWTLVVCFV4RBUDXLEPFJWS6UZB77FYDADQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1jC98jEWn6K8jFHPA9knJeHAkuNEmcS7ThxUvbySDfbq6FmKVR, address:104.36.82.50:4016): protocol: rpc: dial tcp 104.36.82.50:4016: i/o timeout; conn closed: op Jul 28 00:12:43.223255477 (84h36m52.945818517s) [noise=true , address=104.36.82.10:4107 , piece_id=XPLJGM3XZVA7W2R4FJ6BF2DGQKZ653M3P7WWHZ6RSO5NLIRVHLUA, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1UeLnfo3bu6nCXkQDATe2yNhQEn6kZXicg6CFU9mGB37c1QJk4, address:104.36.82.10:4107): protocol: rpc: dial tcp 104.36.82.10:4107: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.223992818 (84h36m52.946555858s) [noise=true , address=104.36.82.55:4195 , piece_id=JGBRIVJF3G2UG6PLD25W7KAC2UPDHAJTF4TXOKR5KWD7LI6DHIRQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:12cizR87omcPERJsRZt64xHfeQyw6BUpBsJPB2txS4LjZR9StMa, address:104.36.82.55:4195): protocol: rpc: dial tcp 104.36.82.55:4195: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224051991 (84h36m52.946615031s) [noise=true , address=104.36.82.51:4074 , piece_id=TQ7QAKXMAXOGRF46IKAMZ3VA6IWBJCTB6AFTUZRAG3CQ74HX5OUQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1DBQpuE1EC1ENCy67We5QhMT6zsa2AbeMDSv8hmQLjokGRvoxc, address:104.36.82.51:4074): protocol: write tcp 188.166.225.170:54962->104.36.82.51:4074: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224118759 (84h36m52.946681799s) [noise=true , address=104.36.82.34:4570 , piece_id=B7SOEIRJVUFC4LAGU35SZZBDWWESX5LSXFZ6NTVRGWAGH764L42A, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:12FX9wGFEYh96uNsKZLGCNRvEGLCmSmcG8a5HxU67yUU6eT1W4f, address:104.36.82.34:4570): protocol: rpc: dial tcp 104.36.82.34:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224163244 (84h36m52.946726284s) [noise=true , address=104.36.82.20:4449 , piece_id=XQVIISPOOAQZKNXM6DFIKHWAARMQ3XGGOMIA4YYVZ3UWL6DWBJBQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1r53UYADNA4XuUzpWdAvUh6T3iUJSbX9YvqnimzoPTgMfSmBWF, address:104.36.82.20:4449): protocol: rpc: dial tcp 104.36.82.20:4449: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224200565 (84h36m52.946763605s) [noise=true , address=104.36.82.52:4088 , piece_id=JZHR6ED3COIONQ535TJD2MLKYNVTIUTU7OKUB5NRQXHLLGI5SZ3A, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:104.36.82.52:4088): protocol: rpc: dial tcp 104.36.82.52:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224250771 (84h36m52.946813811s) [noise=true , address=104.36.82.15:4271 , piece_id=3PSK2BBYK3IM2ENUY73ME4FZBG7VV5E6GSYZH233RCJGL2P5K7MA, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1T9uQjynbTYcaixhvHWCKzatRWpFxMonHFi5idiMQtvivupKSu, address:104.36.82.15:4271): protocol: write tcp 188.166.225.170:59106->104.36.82.15:4271: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224302250 (84h36m52.94686531s) [noise=true , address=104.36.82.5:4854 , piece_id=UYBNJDRX3EXIEKH4GF2LXSWH5QD7LHZFYOPNAQZTL3IL426DF7YQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy, address:104.36.82.5:4854): protocol: rpc: dial tcp 104.36.82.5:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224785615 (84h36m52.947348675s) [noise=true , address=104.36.82.14:4228 , piece_id=HHOYOGXEJUCVJXBKZZZ64CZUHFJTYAGA33JWT74HQRDHHMUASVWQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF, address:104.36.82.14:4228): protocol: rpc: dial tcp 104.36.82.14:4228: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224860487 (84h36m52.947423527s) [noise=true , address=104.36.82.11:4132 , piece_id=PMZUGZJWWAPNDLMQQJVKJQG5LETQNRXWXTAILVSOY2SASRTAKJWQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:17856PRHooRiPyrBYLJggh5uYpdWA9CnGxgCrmVesToNu7FeLb, address:104.36.82.11:4132): protocol: rpc: dial tcp 104.36.82.11:4132: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224914781 (84h36m52.947477831s) [noise=true , address=104.36.82.53:4131 , piece_id=PL6VHDO66CDQ6LTMOR4HFV6AAHNSH3HTMIR5RITJ5J27VSE2BEWQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1uhyc5ozrF9ndeEnQXtjc9o3tsYiAnW1dzeuHV3kv1JS4T4a8C, address:104.36.82.53:4131): protocol: rpc: dial tcp 104.36.82.53:4131: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224940400 (84h36m52.94750344s) [noise=true , address=104.36.82.22:4533 , piece_id=TEAHFVPSGR6JASJLV6YZPVCS7EDL7YA5N2ZKUAGBKRELNVHQOQUA, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:12LXK5pbXavbPZh4YSuEkgk7wsRqwvcVEHv4w9FDRYqSkEU89VF, address:104.36.82.22:4533): protocol: write tcp 188.166.225.170:33168->104.36.82.22:4533: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224966340 (84h36m52.94752937s) [noise=true , address=104.36.82.42:4811 , piece_id=SUIJYI3BQCUO4NVXX5FE2ML76652WXILAOPVPHOEJUEMUWAMEETA, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:124LaFQsBrTNvKgaKTQRHtHxVH6jab6CMTdaRWs7HhfmmYvpef3, address:104.36.82.42:4811): protocol: write tcp 188.166.225.170:46778->104.36.82.42:4811: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.224977803 (84h36m52.947540853s) [noise=true , address=104.36.82.13:4189 , piece_id=CAUOLXHDX2CWR5NDR53RHHWIQ6LH6QDVOPRN4EGSAM37UDPLUTZQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.225009012 (84h36m52.947572062s) [noise=true , address=104.36.82.5:4859 , piece_id=DFNXPHR367TJQ54B2QHOEDCF6KL2NM7GMME5JFHHR7EC46IBHQPQ, seg_pos={0 0}, upload=81199]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 188.166.225.170:43948->104.36.82.5:4859: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:43.225033569 (84h36m52.947596609s) [seg_pos={0 0}, upload=81199]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Jul 28 00:12:43.469862617 (84h36m53.192425657s) [upload=81199]: Done uploading segments... Jul 28 00:12:43.469886983 (84h36m53.192450023s) [upload=81199]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 1m0.248382177s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X.......................................X............X..] duration: 1.881094612s FAIL (2025-07-28 00:12:38 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.881110813s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.904795418s FAIL (2025-07-28 00:12:35 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.904819283s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X.......................................X............X.] duration: 1.824028299s FAIL (2025-07-28 00:12:07 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.824063026s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....................................................X...XXX] duration: 1m0.233579818s FAIL (2025-07-28 00:11:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 4) ======LOGS====== s) [noise=true , address=104.36.82.41:4766 , piece_id=FM4Y6NODBVPQYENOPPSROIVNPRAUERO5JGWKQ36BONSA3TUA7YMQ, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.884066576 (84h34m53.606629616s) [noise=true , address=104.36.82.8:4994 , piece_id=RNZBGEYTK5Z4WS3LUH32F4IV4L3QOWLHQCM36TSEBG25N2RRLYNQ, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.884284081 (84h34m53.606847121s) [noise=true , address=104.36.82.45:4908 , piece_id=5SJDQVNARCLWUTTHM5TPRB3KUZYE3YGVIFFKFY7NXNIIR4SDTIEQ, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.884535182 (84h34m53.607098222s) [noise=true , address=104.36.82.14:4247 , piece_id=CWNR4OU22ZNEK4GKOYL7QJW3WPASM6E26DEGSZC4ER54OGSP23ZA, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.884729384 (84h34m53.607292424s) [noise=true , address=104.36.82.9:4039 , piece_id=COAKKDTPOMU2XY3C3JV4WKKKN2RYO6OSOE75FFZXUPTL5WYWDEQQ, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.885157613 (84h34m53.607720653s) [noise=true , address=64.49.13.138:4482 , piece_id=U3RCE7OUPTYF2O7NJY7QIMP3LKI7MZ3SRTGCDWRZPDZZY4XRGI5A, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.885436476 (84h34m53.607999516s) [noise=true , address=104.36.82.4:4812 , piece_id=VERYPZSXYU532V2UIS22XNCYJLRZBWJJA6E4BQ6LWO23DTOJNUCA, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.885507883 (84h34m53.608070923s) [noise=true , address=104.36.82.13:4189 , piece_id=MUXAJN726ZBDUXY73H5U7VOSZM56YQHJMFAJKRDSFSFIVRNZSXDA, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:43.885733224 (84h34m53.608296254s) [noise=true , address=77.90.31.16:4744 , piece_id=VUBTUBVZLUCJNLTWMV5KJUKRXD2CZNMTTICI7NYPVAIRF425HQRA, seg_pos={0 0}, upload=81182]: Uploading piece... Jul 28 00:10:44.989208530 (84h34m54.71177157s) [upload=81182]: Next returned nil segment Jul 28 00:10:44.989226776 (84h34m54.711789816s) [upload=81182]: Waiting for error group managing segments... Jul 28 00:10:45.638422936 (84h34m55.360985966s) [noise=true , address=79.127.205.245:4246 , piece_id=KEEASWA4WSS34D3GQG4N3CHB3PDWFBACM5MIM2QJJG6EAKN6WVFQ, seg_pos={0 0}, upload=81182]: Done uploading piece. err: <nil> Jul 28 00:10:45.761990220 (84h34m55.48455326s) [noise=true , address=64.49.13.138:4482 , piece_id=U3RCE7OUPTYF2O7NJY7QIMP3LKI7MZ3SRTGCDWRZPDZZY4XRGI5A, seg_pos={0 0}, upload=81182]: Done uploading piece. err: <nil> Jul 28 00:10:45.773216609 (84h34m55.495779649s) [noise=true , address=77.90.31.16:4744 , piece_id=VUBTUBVZLUCJNLTWMV5KJUKRXD2CZNMTTICI7NYPVAIRF425HQRA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: <nil> Jul 28 00:10:45.978370629 (84h34m55.700933659s) [noise=true , address=104.36.82.7:4923 , piece_id=4MCWYW5CYHUTDBSVPRR2PQRW3QG2D4VG6VTX3M3WV5O25LJY7ZXA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: <nil> Jul 28 00:11:42.764442585 (84h35m52.487005635s) [noise=true , address=104.36.82.13:4189 , piece_id=MUXAJN726ZBDUXY73H5U7VOSZM56YQHJMFAJKRDSFSFIVRNZSXDA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: write tcp 188.166.225.170:36278->104.36.82.13:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764587282 (84h35m52.487150333s) [noise=true , address=104.36.82.53:4135 , piece_id=FPRYUQI3P7WSIMQXJDO6WF6OH7Z5N6HUKVSLW2GNEJOFOBLOX67Q, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:128j2QoFq4UDWCXjV8uChmN9KB1sQMnhdF6hGgNQygdqHvw9tPj, address:104.36.82.53:4135): protocol: write tcp 188.166.225.170:39796->104.36.82.53:4135: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764637449 (84h35m52.487200489s) [noise=true , address=104.36.82.41:4766 , piece_id=FM4Y6NODBVPQYENOPPSROIVNPRAUERO5JGWKQ36BONSA3TUA7YMQ, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:1k6zdamuKPkBdzyNZNWx4FCmaTkv33PchcwvTRR8bgcETBs4K7, address:104.36.82.41:4766): protocol: write tcp 188.166.225.170:60174->104.36.82.41:4766: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764648950 (84h35m52.48721199s) [noise=true , address=104.36.82.54:4181 , piece_id=DDWGCZQT2SKPR6ITPJTKARNRQKCHRDSOK4SPEX7KE5OLXQSIHUIA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8, address:104.36.82.54:4181): protocol: write tcp 188.166.225.170:50350->104.36.82.54:4181: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764703134 (84h35m52.487266174s) [noise=true , address=104.36.82.51:4049 , piece_id=KRDFFZ5QQD4WRD6QCNMNDEVK3R55LEMJ5GYSS6YJ56ORCD5QHYNQ, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J, address:104.36.82.51:4049): protocol: write tcp 188.166.225.170:50296->104.36.82.51:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764732821 (84h35m52.487295861s) [noise=true , address=104.36.82.9:4039 , piece_id=COAKKDTPOMU2XY3C3JV4WKKKN2RYO6OSOE75FFZXUPTL5WYWDEQQ, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:12P11WVW9mVXw5ra2gZ3Rezon6wZi8GrN5CchQN3MiVU4ts3L6V, address:104.36.82.9:4039): protocol: write tcp 188.166.225.170:54378->104.36.82.9:4039: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764756025 (84h35m52.487319075s) [noise=true , address=104.36.82.8:4994 , piece_id=RNZBGEYTK5Z4WS3LUH32F4IV4L3QOWLHQCM36TSEBG25N2RRLYNQ, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:13nneaPpsRT7mVEc6cDt7GiZSMTU68Nnk1rr9Lbn5ycZkmQGrB, address:104.36.82.8:4994): protocol: write tcp 188.166.225.170:37814->104.36.82.8:4994: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764805290 (84h35m52.48736833s) [noise=true , address=104.36.82.44:4900 , piece_id=2BTSPXQAY7343QCS2TQSGYM5R2IBSOYISA5BJS5GAESQZTGHXR3Q, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ, address:104.36.82.44:4900): protocol: write tcp 188.166.225.170:49444->104.36.82.44:4900: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764853161 (84h35m52.487416201s) [noise=true , address=104.36.82.20:4444 , piece_id=PSHLTCBAJDJ552A6Q4OQAS3DJMOFEOHC7HPSJNLKFH5VJZKRDPZQ, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:12m5PditUsvMEejqnuEBZ6jLunbkTw9dEkmGzLcBg4y2XAwhBTD, address:104.36.82.20:4444): protocol: write tcp 188.166.225.170:48144->104.36.82.20:4444: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764883088 (84h35m52.487446128s) [noise=true , address=104.36.82.15:4284 , piece_id=TFS46DLIKXFOQPBRDZHP6JQSHG6CZRL5RX7ZR4P66RPOUBNANNHA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:1YAnLu8onh19Mx524VikQzCHEFW4U8dgtuLx8amtQAiReSCisF, address:104.36.82.15:4284): protocol: write tcp 188.166.225.170:44114->104.36.82.15:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764904188 (84h35m52.487467228s) [noise=true , address=104.36.82.3:4789 , piece_id=AYGT74A5RXC3ZZY2TQUG2RBC43A3BSBR355CLX6GWU452IDDU6YA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:12eQnnZm3aoAEA6cHJshERFmZuyh5cUjqzYK687CS27CQ8nGzrT, address:104.36.82.3:4789): protocol: write tcp 188.166.225.170:37356->104.36.82.3:4789: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764933184 (84h35m52.487496244s) [noise=true , address=104.36.82.14:4247 , piece_id=CWNR4OU22ZNEK4GKOYL7QJW3WPASM6E26DEGSZC4ER54OGSP23ZA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:1262xxX6aUPTYgKdvRxAyc77PmPBWJtq5cXRJFoELxHbfn18DLE, address:104.36.82.14:4247): protocol: write tcp 188.166.225.170:54402->104.36.82.14:4247: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764942492 (84h35m52.487505522s) [noise=true , address=104.36.82.45:4908 , piece_id=5SJDQVNARCLWUTTHM5TPRB3KUZYE3YGVIFFKFY7NXNIIR4SDTIEQ, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:104.36.82.45:4908): protocol: write tcp 188.166.225.170:33678->104.36.82.45:4908: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764953553 (84h35m52.487516593s) [noise=true , address=104.36.82.4:4812 , piece_id=VERYPZSXYU532V2UIS22XNCYJLRZBWJJA6E4BQ6LWO23DTOJNUCA, seg_pos={0 0}, upload=81182]: Done uploading piece. err: ecclient: upload failed (node:12gTRhEnzLoKmQYRttr4hwiTbJ4y3yqMUS1Qg7F2yohb81sd5KV, address:104.36.82.4:4812): protocol: write tcp 188.166.225.170:59874->104.36.82.4:4812: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:42.764974523 (84h35m52.487537553s) [seg_pos={0 0}, upload=81182]: Done waiting for segment. successful: 4 optimal: 14 errs: <nil> Jul 28 00:11:42.995571571 (84h35m52.718134641s) [upload=81182]: Done uploading segments... Jul 28 00:11:42.995600947 (84h35m52.718163987s) [upload=81182]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 4) Duration: 1m0.233592382s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.87103676s FAIL (2025-07-28 00:11:35 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.871068119s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X.......................................X............X] duration: 1.84219626s FAIL (2025-07-28 00:11:21 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.842223152s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.821992146s FAIL (2025-07-28 00:10:44 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.822019727s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X.......................................X............] duration: 2.028961908s FAIL (2025-07-28 00:10:44 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 2.028990913s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................................................X...XX] duration: 1m0.245379391s FAIL (2025-07-28 00:10:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== :43.377513164 (84h33m53.100076214s) [noise=true , address=104.36.82.12:4157 , piece_id=744PJ6HDZTPM7K34ERAKAGUTLTWUOCSJNEANUWY52BTXDLBUJUOQ, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:43.377543082 (84h33m53.100106122s) [noise=true , address=104.36.82.2:4760 , piece_id=CVGWFNKA7OMFGNQBCSL6ONGLLUEHPYJ343NJUX46OUEGSEYAS7RQ, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:43.378025575 (84h33m53.100588625s) [noise=true , address=104.36.82.3:4794 , piece_id=4NFMF7ONTNIT55APHACX3VBR3TSECNYBR3NXWZUHDS5TCRY2TMEQ, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:43.382170004 (84h33m53.104733034s) [noise=true , address=104.36.82.14:4241 , piece_id=7DV6YUYEVSIADPGUYQW2RTHYUZLGHUJYJCJ2IRL7I4ERHYUNZBBA, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:43.382612150 (84h33m53.10517519s) [noise=true , address=104.36.82.40:4962 , piece_id=ERSOQN7HRBXWBMOUSM4EIFKR3EINI7TNR7OZ5WACFDXGFKSZ4EZQ, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:43.382918917 (84h33m53.105481957s) [noise=true , address=104.36.82.20:4467 , piece_id=EYBCJ73L2W5XDWGBAMIPT2KIGDAOTRTSRMC3AKMF3IVEJS6TKISQ, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:43.387597778 (84h33m53.110160818s) [noise=true , address=104.36.82.55:4201 , piece_id=XNDLF4I5Z7M7TITJ25LXPKN3OF74RXHF6SXYTZZNQS47VTJZHQAA, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:43.389907087 (84h33m53.112470177s) [noise=true , address=104.36.82.18:4365 , piece_id=XLPIEQIULL5I56SB5LYBNRGG2EZBDOGDVW37YJGWEMZ7S7E5CGBQ, seg_pos={0 0}, upload=81162]: Uploading piece... Jul 28 00:09:44.473835384 (84h33m54.196398424s) [upload=81162]: Next returned nil segment Jul 28 00:09:44.473851093 (84h33m54.196414133s) [upload=81162]: Waiting for error group managing segments... Jul 28 00:09:44.982312294 (84h33m54.704875334s) [noise=true , address=79.127.205.234:4606 , piece_id=NCKOFXTJXYDUZGVTCYMV2BOVRZOTWKMEH2BT7HCPHS5QCAP6I6JQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: <nil> Jul 28 00:09:45.372269466 (84h33m55.094832506s) [noise=true , address=104.36.82.18:4365 , piece_id=XLPIEQIULL5I56SB5LYBNRGG2EZBDOGDVW37YJGWEMZ7S7E5CGBQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: <nil> Jul 28 00:09:45.606534291 (84h33m55.329097331s) [noise=true , address=104.36.82.43:4848 , piece_id=QI3F6VENDAPML5BEAUNN22UEV4OSF7EHZ3TIJ2X3IGXOWQC4CPOQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: <nil> Jul 28 00:10:42.287984924 (84h34m52.010547954s) [noise=true , address=104.36.82.2:4760 , piece_id=CVGWFNKA7OMFGNQBCSL6ONGLLUEHPYJ343NJUX46OUEGSEYAS7RQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:104.36.82.2:4760): protocol: write tcp 188.166.225.170:36670->104.36.82.2:4760: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288030581 (84h34m52.010593621s) [noise=true , address=104.36.82.13:4203 , piece_id=3TSTKRO2CYYKUJJYZZN25H7CWDSJKPCWFTWHRTVW4SWBJ4YHUZTQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:18cNSsgqn3n6z5LxRcVCRzDzfFDpvptV1MKh6NdNRLW4bg9fWM, address:104.36.82.13:4203): protocol: write tcp 188.166.225.170:53796->104.36.82.13:4203: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288065208 (84h34m52.010628248s) [noise=true , address=104.36.82.10:4082 , piece_id=PHJVLLKNIDZ3MMN4ZSGPGU3L5BLGRVKUX3ZRCQIZTPTBDZJ6PPMQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:12DKsNCtqxLvpJwLszdLs74V3eb8NH2VAV9V3bngzUczawmNoLK, address:104.36.82.10:4082): protocol: write tcp 188.166.225.170:40690->104.36.82.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288125192 (84h34m52.010688232s) [noise=true , address=104.36.82.41:4776 , piece_id=76PZWFMVFEOTLEPVIOTAPV5XYNXBO3NQQYXIFPBTKGICCDGS7R5Q, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:1Hjw4yBSJfpaGqUWqAqfqc1P9ThM6kwd5vMgbLCrSR8z9eiqH7, address:104.36.82.41:4776): protocol: write tcp 188.166.225.170:38624->104.36.82.41:4776: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288180769 (84h34m52.010743809s) [noise=true , address=104.36.82.11:4116 , piece_id=E6SQCKU3S5N3OTTRJGGZ7EXP4IQNFO6WZEM5Z6BNSVY3SORIPYRA, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:123aoo9g11aJP9hiL8shu2dx44tjyKzEWqPUjHUdXtR7LLFyng8, address:104.36.82.11:4116): protocol: write tcp 188.166.225.170:53992->104.36.82.11:4116: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288224723 (84h34m52.010787763s) [noise=true , address=104.36.82.55:4201 , piece_id=XNDLF4I5Z7M7TITJ25LXPKN3OF74RXHF6SXYTZZNQS47VTJZHQAA, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:12bPDvhDfu8Z58LxZcicg1vAiiu1sZYGpwQnvuhk4t5m6yR87Fi, address:104.36.82.55:4201): protocol: write tcp 188.166.225.170:46394->104.36.82.55:4201: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288231646 (84h34m52.010794686s) [noise=true , address=104.36.82.15:4268 , piece_id=GYT2S2C2Z5CF77BZPRVEOHC7BL54A26UZOL5QYQG6ZCAACKFAIQA, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:112ocg8g8hf2huUskC1Kty3z51wXc8VuNUgARTFjKZxsF6RFFy, address:104.36.82.15:4268): protocol: write tcp 188.166.225.170:51732->104.36.82.15:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288263357 (84h34m52.010826397s) [noise=true , address=104.36.82.54:4167 , piece_id=RYMAC23WKKOTASCFTPQGYB57HYMARQM23ZQKR4DLZBPPWJK36OCA, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ, address:104.36.82.54:4167): protocol: write tcp 188.166.225.170:56326->104.36.82.54:4167: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288269418 (84h34m52.010832458s) [noise=true , address=104.36.82.3:4794 , piece_id=4NFMF7ONTNIT55APHACX3VBR3TSECNYBR3NXWZUHDS5TCRY2TMEQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:104.36.82.3:4794): protocol: write tcp 188.166.225.170:35092->104.36.82.3:4794: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288294236 (84h34m52.010857276s) [noise=true , address=104.36.82.42:4800 , piece_id=EIHZ4OJPUDI4E677NN3B4VKMRGORZGZ6V5BV7RESCMDMEX56ETHQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:121yHupysREmASSVx3WUN57duu16QEs7sA2BPBWyaThFzruvch2, address:104.36.82.42:4800): protocol: write tcp 188.166.225.170:55988->104.36.82.42:4800: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288302681 (84h34m52.010865711s) [noise=true , address=104.36.82.40:4962 , piece_id=ERSOQN7HRBXWBMOUSM4EIFKR3EINI7TNR7OZ5WACFDXGFKSZ4EZQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:13va7LjDtQV2ob7mrUaJUXc64HmZG3svoDaErmypjYHVAcw1o3, address:104.36.82.40:4962): protocol: write tcp 188.166.225.170:50218->104.36.82.40:4962: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288323061 (84h34m52.010886101s) [noise=true , address=104.36.82.12:4157 , piece_id=744PJ6HDZTPM7K34ERAKAGUTLTWUOCSJNEANUWY52BTXDLBUJUOQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:12vPyYh3yrhc3zt4nd5C6TjHGaMAHGcpVwLTcgYUqCKGhAvicsX, address:104.36.82.12:4157): protocol: write tcp 188.166.225.170:57882->104.36.82.12:4157: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288334724 (84h34m52.010897754s) [noise=true , address=104.36.82.20:4467 , piece_id=EYBCJ73L2W5XDWGBAMIPT2KIGDAOTRTSRMC3AKMF3IVEJS6TKISQ, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:12f6rDHMRpZZmvJxShMhAS5KKGbEEgNaBayPKCyxVqpPk4knnbR, address:104.36.82.20:4467): protocol: write tcp 188.166.225.170:58656->104.36.82.20:4467: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288424305 (84h34m52.010987345s) [noise=true , address=104.36.82.14:4241 , piece_id=7DV6YUYEVSIADPGUYQW2RTHYUZLGHUJYJCJ2IRL7I4ERHYUNZBBA, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR, address:104.36.82.14:4241): protocol: write tcp 188.166.225.170:39564->104.36.82.14:4241: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:10:42.288501653 (84h34m52.011064693s) [noise=true , address=104.36.82.5:4872 , piece_id=OFZQKOU5KO33L44YU66I74LCCCJEKHRUUD6PYL237ZABXRK6MGGA, seg_pos={0 0}, upload=81162]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: context deadline exceeded; context deadline exceeded Jul 28 00:10:42.288533794 (84h34m52.011096834s) [seg_pos={0 0}, upload=81162]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Jul 28 00:10:42.531852360 (84h34m52.2544154s) [upload=81162]: Done uploading segments... Jul 28 00:10:42.531890093 (84h34m52.254453123s) [upload=81162]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 1m0.245392306s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.246545031s FAIL (2025-07-28 00:10:22 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.246568517s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X.......................................X...........] duration: 1.867815323s FAIL (2025-07-28 00:10:21 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.8678659s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X...X] duration: 1m0.233305317s FAIL (2025-07-28 00:09:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 4) ======LOGS====== ce_id=AEDCJNXO7Z5AZPSSLWPFPRWWFDVRYCSWRHMPECTDLEA4N22I74ZQ, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.920770705 (84h32m52.643333745s) [noise=true , address=104.36.82.17:4335 , piece_id=GEK5EQHRJZM7FQT4C4IVNJMNS5FHLFGHNHNVDGIEMKLG3WQQAQUQ, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.922022541 (84h32m52.644585581s) [noise=true , address=104.36.82.20:4455 , piece_id=TEI53QZAZWK6VZ6JSVDKAAI2AW6PH42RIC3AVYFSYOWMX2D7GKDQ, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.922428427 (84h32m52.644991467s) [noise=true , address=104.36.82.11:4147 , piece_id=C377GGUKV6KDRIOM7BECBTBUJAWVKFDNQS3ZUNFF46EKBQDXIIOQ, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.922496758 (84h32m52.645059798s) [noise=true , address=104.36.82.40:4947 , piece_id=EEZMWRSSZSLBLVBSP3G7GYRDLROR5QHJBK2GRTLF7EDL5CBIVCTQ, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.922806410 (84h32m52.64536945s) [noise=true , address=104.36.82.12:4156 , piece_id=LUW4V7VTDNYFBYC5ORJXZHAEHDWJHTOALU7IRMUBJRINX5K24MFA, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.923653070 (84h32m52.64621611s) [noise=true , address=104.36.82.13:4200 , piece_id=XEYENT5RCOJIWMC37NGMTPYL2DV4KHM3RIJTNA7BNTMZW7RWEAKA, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.927646721 (84h32m52.650209761s) [noise=true , address=104.36.82.18:4390 , piece_id=WUO6CORSLMSGTYKL2RLJXQJDVLGXNILTBYX7KXUKZX4XZOG6RFJQ, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.929602733 (84h32m52.652165773s) [noise=true , address=45.91.116.9:4291 , piece_id=SZ73HLA7XWRTC6KCKIWQO4CPWARWJWM6BEZT73AFZUPIOBL5AAWQ, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:42.930870278 (84h32m52.653433308s) [noise=true , address=104.36.82.15:4266 , piece_id=FWQJEPF44PDZKMHKXSQLJLCR3LDFGGRGRCIPCDVB3RHBAQIVKXLA, seg_pos={0 0}, upload=81148]: Uploading piece... Jul 28 00:08:44.461508253 (84h32m54.184071293s) [upload=81148]: Next returned nil segment Jul 28 00:08:44.461523613 (84h32m54.184086653s) [upload=81148]: Waiting for error group managing segments... Jul 28 00:08:45.042885889 (84h32m54.765448929s) [noise=true , address=45.91.116.9:4291 , piece_id=SZ73HLA7XWRTC6KCKIWQO4CPWARWJWM6BEZT73AFZUPIOBL5AAWQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: <nil> Jul 28 00:08:45.266954196 (84h32m54.989517236s) [noise=true , address=79.127.201.215:4349 , piece_id=AEDCJNXO7Z5AZPSSLWPFPRWWFDVRYCSWRHMPECTDLEA4N22I74ZQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: <nil> Jul 28 00:08:57.539583696 (84h33m7.262146736s) [noise=true , address=104.36.82.18:4390 , piece_id=WUO6CORSLMSGTYKL2RLJXQJDVLGXNILTBYX7KXUKZX4XZOG6RFJQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: <nil> Jul 28 00:09:02.167817621 (84h33m11.890380661s) [noise=true , address=104.36.82.17:4335 , piece_id=GEK5EQHRJZM7FQT4C4IVNJMNS5FHLFGHNHNVDGIEMKLG3WQQAQUQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: <nil> Jul 28 00:09:41.817195086 (84h33m51.539758126s) [noise=true , address=104.36.82.9:4036 , piece_id=65RCNTTGT5BAMNUARLYYXFDVGSRZ5QAXEEREOYWCWLMETNJC3NYA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:12Tcd5VLN93v4Aijkh1Mkyjuu42vKpN93qSGzbn7UGDVNsPAMKy, address:104.36.82.9:4036): protocol: rpc: dial tcp 104.36.82.9:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817267955 (84h33m51.539830995s) [noise=true , address=104.36.82.12:4156 , piece_id=LUW4V7VTDNYFBYC5ORJXZHAEHDWJHTOALU7IRMUBJRINX5K24MFA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:12JTrtKCNHFUY91Ktaa7v7eAWe4GHssKSeofrg3diu8isHJnmy4, address:104.36.82.12:4156): protocol: rpc: dial tcp 104.36.82.12:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817307661 (84h33m51.539870701s) [noise=true , address=104.36.82.15:4266 , piece_id=FWQJEPF44PDZKMHKXSQLJLCR3LDFGGRGRCIPCDVB3RHBAQIVKXLA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:1wH8jka9Jw8JLYdGKuit8XoJjVLJRDKJ5ePgeei16eax6mk3j, address:104.36.82.15:4266): protocol: rpc: dial tcp 104.36.82.15:4266: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817333361 (84h33m51.539896401s) [noise=true , address=104.36.82.11:4136 , piece_id=DXH6XISLB6AMD6BEEEAGLJPIPIXIHKUJEGTHRMDYNQXFPOXMHR3A, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:127n8CMbZQ7haiv6tGHrVg9V8Yf12sYkcbL9mEbSpQ4WkT9isnp, address:104.36.82.11:4136): protocol: rpc: dial tcp 104.36.82.11:4136: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817518063 (84h33m51.540081103s) [noise=true , address=104.36.82.13:4200 , piece_id=XEYENT5RCOJIWMC37NGMTPYL2DV4KHM3RIJTNA7BNTMZW7RWEAKA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:12dfLumooVsDsWXqi5FQMDutkcexM9A5Kmu4Vo9s1TqfWxv5ozH, address:104.36.82.13:4200): protocol: write tcp 188.166.225.170:56006->104.36.82.13:4200: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817591945 (84h33m51.540154985s) [noise=true , address=104.36.82.52:4092 , piece_id=XYKGSVU3MEGKTGZDUXGWVBSSGA3BGOHXAEIMSE7A6OIVLHIMVJTA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:12wYaUu5QpFU8T4mZt1iqeHqVJKJ5CyVW5vkeTWf1a8G3pLsx3P, address:104.36.82.52:4092): protocol: write tcp 188.166.225.170:57938->104.36.82.52:4092: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817645938 (84h33m51.540208978s) [noise=true , address=104.36.82.21:4498 , piece_id=HBK26NDVHTUVWSX3CENWWP6FUSNVDLULH6G2FMFGALWRC5WDN3CA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:1UhkkwqK6ywvVTN6mF5kVMHwsbhUfqafUUWqTthYT5UBXvahPi, address:104.36.82.21:4498): protocol: write tcp 188.166.225.170:58870->104.36.82.21:4498: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817726813 (84h33m51.540289853s) [noise=true , address=104.36.82.20:4455 , piece_id=TEI53QZAZWK6VZ6JSVDKAAI2AW6PH42RIC3AVYFSYOWMX2D7GKDQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:1X8uFZXHVMycvk6tELmYQyWoAS2sSFmNNWhvQFApvoWXuXFcj4, address:104.36.82.20:4455): protocol: write tcp 188.166.225.170:40304->104.36.82.20:4455: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817764555 (84h33m51.540327595s) [noise=true , address=104.36.82.11:4147 , piece_id=C377GGUKV6KDRIOM7BECBTBUJAWVKFDNQS3ZUNFF46EKBQDXIIOQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P, address:104.36.82.11:4147): protocol: write tcp 188.166.225.170:57280->104.36.82.11:4147: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817825893 (84h33m51.540388933s) [noise=true , address=104.36.82.56:4252 , piece_id=76ZSXRCYA644LSZTKXP3GJQLI4P5H3EAJQZCOX66ZVUUK37R36QA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:1UDFNiqXb4riRuewJDPrKFykVWLiryNKqgkH6uCZszz6Sr8naB, address:104.36.82.56:4252): protocol: write tcp 188.166.225.170:44034->104.36.82.56:4252: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817870067 (84h33m51.540433107s) [noise=true , address=104.36.82.44:4901 , piece_id=IRUDLXMD4PQCKVZFJXTTIWV7KYD6EWUWOKOVTPI2ZWKNOFFLV37A, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1, address:104.36.82.44:4901): protocol: write tcp 188.166.225.170:47318->104.36.82.44:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817908201 (84h33m51.540471241s) [noise=true , address=104.36.82.47:4528 , piece_id=NZZE4HYGQVQJI7NYWHUV4EXXPPUUV57WWRBYFOXET32PDMPUN6RA, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:12ArcCrcHdpNgBMfTcPdtTXb65RgnTh8N32ihHAx2RrddxnRYgT, address:104.36.82.47:4528): protocol: write tcp 188.166.225.170:39002->104.36.82.47:4528: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817954428 (84h33m51.540517468s) [noise=true , address=104.36.82.14:4237 , piece_id=VKGSMZCY2TCAZUGDIHCT3FDH5I3CE5GZOHG4PWKNE4F3MMWBIKWQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa, address:104.36.82.14:4237): protocol: write tcp 188.166.225.170:38782->104.36.82.14:4237: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817962194 (84h33m51.540525234s) [noise=true , address=104.36.82.40:4947 , piece_id=EEZMWRSSZSLBLVBSP3G7GYRDLROR5QHJBK2GRTLF7EDL5CBIVCTQ, seg_pos={0 0}, upload=81148]: Done uploading piece. err: ecclient: upload failed (node:1vVHmSRAfugvyvTkEZHitE4uFMGXxgrbnWfJuGD9MzS9avAYsU, address:104.36.82.40:4947): protocol: write tcp 188.166.225.170:53142->104.36.82.40:4947: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:41.817978965 (84h33m51.540542005s) [seg_pos={0 0}, upload=81148]: Done waiting for segment. successful: 4 optimal: 14 errs: <nil> Jul 28 00:09:42.048094152 (84h33m51.770657192s) [upload=81148]: Done uploading segments... Jul 28 00:09:42.048122306 (84h33m51.770685346s) [upload=81148]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 4) Duration: 1m0.233335276s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X.......................................X..........] duration: 1.854990518s FAIL (2025-07-28 00:09:17 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.855029622s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 19.016264078s FAIL (2025-07-28 00:08:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ding segments... Jul 28 00:05:06.856881912 (84h29m16.579444942s) [upload=81093]: Got next segment. Inline: false Jul 28 00:05:06.856917510 (84h29m16.57948054s) [upload=81093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:05:06.856922240 (84h29m16.57948528s) [upload=81093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:05:07.300053058 (84h29m17.022616128s) [seg_pos={0 0}, upload=81093]: Begin upload segment... Jul 28 00:05:07.300126248 (84h29m17.022689288s) [seg_pos={0 0}, upload=81093]: Done begin upload segment. Jul 28 00:05:07.300182636 (84h29m17.022745676s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300202935 (84h29m17.022766035s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300714974 (84h29m17.023278014s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300954282 (84h29m17.023517352s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301133234 (84h29m17.023696274s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301337816 (84h29m17.023900866s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301416717 (84h29m17.023979757s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301711901 (84h29m17.024274941s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302391141 (84h29m17.024954181s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302660266 (84h29m17.025223306s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302955371 (84h29m17.025518411s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303200078 (84h29m17.025763119s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303235567 (84h29m17.025798607s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303502577 (84h29m17.026065617s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303768326 (84h29m17.026331366s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.304655934 (84h29m17.027218974s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305586635 (84h29m17.028149685s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305940262 (84h29m17.028503302s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:08.417889936 (84h29m18.140452976s) [upload=81093]: Next returned nil segment Jul 28 00:05:08.417907189 (84h29m18.140470229s) [upload=81093]: Waiting for error group managing segments... Jul 28 00:05:09.022882353 (84h29m18.745445393s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.265315719 (84h29m18.987878759s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.330369065 (84h29m19.052932105s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.467249498 (84h29m19.189812558s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:10.571912990 (84h29m20.29447603s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:19.291285105 (84h29m29.013848155s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:21.287633954 (84h29m31.010197004s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:27.360309233 (84h29m37.082872273s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:32.960614498 (84h29m42.683177538s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:35.413610316 (84h29m45.136173346s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:36.109525520 (84h29m45.83208856s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:38.196788062 (84h29m47.919351102s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:00.188535918 (84h30m9.911098959s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:06.210902795 (84h30m15.933465835s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:104.36.82.52:4089): protocol: write tcp 188.166.225.170:55522->104.36.82.52:4089: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211026813 (84h30m15.933589853s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, address:104.36.82.46:4485): protocol: write tcp 188.166.225.170:47740->104.36.82.46:4485: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211076278 (84h30m15.933639318s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:104.36.82.21:4474): protocol: rpc: dial tcp 104.36.82.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211129189 (84h30m15.933692229s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:104.36.82.54:4186): protocol: rpc: dial tcp 104.36.82.54:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211185176 (84h30m15.933748216s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:17856PRHooRiPyrBYLJggh5uYpdWA9CnGxgCrmVesToNu7FeLb, address:104.36.82.11:4132): protocol: write tcp 188.166.225.170:59180->104.36.82.11:4132: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211199904 (84h30m15.933762944s) [seg_pos={0 0}, upload=81093]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 28 00:06:06.439347605 (84h30m16.161910645s) [upload=81093]: Done uploading segments... Jul 28 00:06:06.439375689 (84h30m16.161938729s) [upload=81093]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 19.016286973s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X.......................................X.........] duration: 1.837786229s FAIL (2025-07-28 00:08:08 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.837814775s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 40.845190759s FAIL (2025-07-28 00:07:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ding segments... Jul 28 00:05:06.856881912 (84h29m16.579444942s) [upload=81093]: Got next segment. Inline: false Jul 28 00:05:06.856917510 (84h29m16.57948054s) [upload=81093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:05:06.856922240 (84h29m16.57948528s) [upload=81093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:05:07.300053058 (84h29m17.022616128s) [seg_pos={0 0}, upload=81093]: Begin upload segment... Jul 28 00:05:07.300126248 (84h29m17.022689288s) [seg_pos={0 0}, upload=81093]: Done begin upload segment. Jul 28 00:05:07.300182636 (84h29m17.022745676s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300202935 (84h29m17.022766035s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300714974 (84h29m17.023278014s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300954282 (84h29m17.023517352s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301133234 (84h29m17.023696274s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301337816 (84h29m17.023900866s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301416717 (84h29m17.023979757s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301711901 (84h29m17.024274941s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302391141 (84h29m17.024954181s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302660266 (84h29m17.025223306s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302955371 (84h29m17.025518411s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303200078 (84h29m17.025763119s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303235567 (84h29m17.025798607s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303502577 (84h29m17.026065617s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303768326 (84h29m17.026331366s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.304655934 (84h29m17.027218974s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305586635 (84h29m17.028149685s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305940262 (84h29m17.028503302s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:08.417889936 (84h29m18.140452976s) [upload=81093]: Next returned nil segment Jul 28 00:05:08.417907189 (84h29m18.140470229s) [upload=81093]: Waiting for error group managing segments... Jul 28 00:05:09.022882353 (84h29m18.745445393s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.265315719 (84h29m18.987878759s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.330369065 (84h29m19.052932105s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.467249498 (84h29m19.189812558s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:10.571912990 (84h29m20.29447603s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:19.291285105 (84h29m29.013848155s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:21.287633954 (84h29m31.010197004s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:27.360309233 (84h29m37.082872273s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:32.960614498 (84h29m42.683177538s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:35.413610316 (84h29m45.136173346s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:36.109525520 (84h29m45.83208856s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:38.196788062 (84h29m47.919351102s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:00.188535918 (84h30m9.911098959s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:06.210902795 (84h30m15.933465835s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:104.36.82.52:4089): protocol: write tcp 188.166.225.170:55522->104.36.82.52:4089: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211026813 (84h30m15.933589853s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, address:104.36.82.46:4485): protocol: write tcp 188.166.225.170:47740->104.36.82.46:4485: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211076278 (84h30m15.933639318s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:104.36.82.21:4474): protocol: rpc: dial tcp 104.36.82.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211129189 (84h30m15.933692229s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:104.36.82.54:4186): protocol: rpc: dial tcp 104.36.82.54:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211185176 (84h30m15.933748216s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:17856PRHooRiPyrBYLJggh5uYpdWA9CnGxgCrmVesToNu7FeLb, address:104.36.82.11:4132): protocol: write tcp 188.166.225.170:59180->104.36.82.11:4132: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211199904 (84h30m15.933762944s) [seg_pos={0 0}, upload=81093]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 28 00:06:06.439347605 (84h30m16.161910645s) [upload=81093]: Done uploading segments... Jul 28 00:06:06.439375689 (84h30m16.161938729s) [upload=81093]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 40.845218503s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X.......................................X........] duration: 1.825317827s FAIL (2025-07-28 00:07:13 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.825342775s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 32.121546204s FAIL (2025-07-28 00:06:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ding segments... Jul 28 00:05:06.856881912 (84h29m16.579444942s) [upload=81093]: Got next segment. Inline: false Jul 28 00:05:06.856917510 (84h29m16.57948054s) [upload=81093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:05:06.856922240 (84h29m16.57948528s) [upload=81093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:05:07.300053058 (84h29m17.022616128s) [seg_pos={0 0}, upload=81093]: Begin upload segment... Jul 28 00:05:07.300126248 (84h29m17.022689288s) [seg_pos={0 0}, upload=81093]: Done begin upload segment. Jul 28 00:05:07.300182636 (84h29m17.022745676s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300202935 (84h29m17.022766035s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300714974 (84h29m17.023278014s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300954282 (84h29m17.023517352s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301133234 (84h29m17.023696274s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301337816 (84h29m17.023900866s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301416717 (84h29m17.023979757s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301711901 (84h29m17.024274941s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302391141 (84h29m17.024954181s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302660266 (84h29m17.025223306s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302955371 (84h29m17.025518411s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303200078 (84h29m17.025763119s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303235567 (84h29m17.025798607s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303502577 (84h29m17.026065617s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303768326 (84h29m17.026331366s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.304655934 (84h29m17.027218974s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305586635 (84h29m17.028149685s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305940262 (84h29m17.028503302s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:08.417889936 (84h29m18.140452976s) [upload=81093]: Next returned nil segment Jul 28 00:05:08.417907189 (84h29m18.140470229s) [upload=81093]: Waiting for error group managing segments... Jul 28 00:05:09.022882353 (84h29m18.745445393s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.265315719 (84h29m18.987878759s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.330369065 (84h29m19.052932105s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.467249498 (84h29m19.189812558s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:10.571912990 (84h29m20.29447603s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:19.291285105 (84h29m29.013848155s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:21.287633954 (84h29m31.010197004s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:27.360309233 (84h29m37.082872273s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:32.960614498 (84h29m42.683177538s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:35.413610316 (84h29m45.136173346s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:36.109525520 (84h29m45.83208856s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:38.196788062 (84h29m47.919351102s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:00.188535918 (84h30m9.911098959s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:06.210902795 (84h30m15.933465835s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:104.36.82.52:4089): protocol: write tcp 188.166.225.170:55522->104.36.82.52:4089: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211026813 (84h30m15.933589853s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, address:104.36.82.46:4485): protocol: write tcp 188.166.225.170:47740->104.36.82.46:4485: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211076278 (84h30m15.933639318s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:104.36.82.21:4474): protocol: rpc: dial tcp 104.36.82.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211129189 (84h30m15.933692229s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:104.36.82.54:4186): protocol: rpc: dial tcp 104.36.82.54:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211185176 (84h30m15.933748216s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:17856PRHooRiPyrBYLJggh5uYpdWA9CnGxgCrmVesToNu7FeLb, address:104.36.82.11:4132): protocol: write tcp 188.166.225.170:59180->104.36.82.11:4132: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211199904 (84h30m15.933762944s) [seg_pos={0 0}, upload=81093]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 28 00:06:06.439347605 (84h30m16.161910645s) [upload=81093]: Done uploading segments... Jul 28 00:06:06.439375689 (84h30m16.161938729s) [upload=81093]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 32.121603623s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.233857276s FAIL (2025-07-28 00:06:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ding segments... Jul 28 00:05:06.856881912 (84h29m16.579444942s) [upload=81093]: Got next segment. Inline: false Jul 28 00:05:06.856917510 (84h29m16.57948054s) [upload=81093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:05:06.856922240 (84h29m16.57948528s) [upload=81093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:05:07.300053058 (84h29m17.022616128s) [seg_pos={0 0}, upload=81093]: Begin upload segment... Jul 28 00:05:07.300126248 (84h29m17.022689288s) [seg_pos={0 0}, upload=81093]: Done begin upload segment. Jul 28 00:05:07.300182636 (84h29m17.022745676s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300202935 (84h29m17.022766035s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300714974 (84h29m17.023278014s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.300954282 (84h29m17.023517352s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301133234 (84h29m17.023696274s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301337816 (84h29m17.023900866s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301416717 (84h29m17.023979757s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.301711901 (84h29m17.024274941s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302391141 (84h29m17.024954181s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302660266 (84h29m17.025223306s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.302955371 (84h29m17.025518411s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303200078 (84h29m17.025763119s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303235567 (84h29m17.025798607s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303502577 (84h29m17.026065617s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.303768326 (84h29m17.026331366s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.304655934 (84h29m17.027218974s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305586635 (84h29m17.028149685s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:07.305940262 (84h29m17.028503302s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Uploading piece... Jul 28 00:05:08.417889936 (84h29m18.140452976s) [upload=81093]: Next returned nil segment Jul 28 00:05:08.417907189 (84h29m18.140470229s) [upload=81093]: Waiting for error group managing segments... Jul 28 00:05:09.022882353 (84h29m18.745445393s) [noise=true , address=64.49.13.138:4483 , piece_id=VS2VNR5N4BFAHV4U6FVVO7NVLX6HPUDVTKBPGYPVFU3OPLSN2P6A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.265315719 (84h29m18.987878759s) [noise=true , address=104.36.82.40:4963 , piece_id=N4BFY65CU243DNTVHKJ4JGM3GMGFL7CXFR4FWGVS2BMDD6EJFGEQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.330369065 (84h29m19.052932105s) [noise=true , address=104.36.82.8:4002 , piece_id=A45UNZDUJ75SSE44PYIIO7LWIF4DWVVS5PLIE6TRGNB3HXSS6AWQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:09.467249498 (84h29m19.189812558s) [noise=true , address=79.127.219.38:4018 , piece_id=4ZFZL3LXBDEIHOPDMZPYOXGAG7QEG3WOMPNUCXKWCTRKEEETXCFA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:10.571912990 (84h29m20.29447603s) [noise=true , address=104.36.82.10:4101 , piece_id=GIOVDZYVIXGXGILKEZLPP2OU5EAK5674M3OTZDFBQHJHOZIU44RA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:19.291285105 (84h29m29.013848155s) [noise=true , address=104.36.82.53:4153 , piece_id=KXI2BI2PRBR44OG5IWW2VF5H25IUOVSLGQFBUTT6RNLOPOPEUJ4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:21.287633954 (84h29m31.010197004s) [noise=true , address=104.36.82.9:4024 , piece_id=LDOSOHSL75NMUGKJUI35XAOX6RV2HYZB7K45U3HQQKDILQWTGBXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:27.360309233 (84h29m37.082872273s) [noise=true , address=104.36.82.56:4244 , piece_id=YRK2C3Q4CUQFW7MC24NTMU7243WJNWNN4P4FV7VNWR7XJPD6CSEA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:32.960614498 (84h29m42.683177538s) [noise=true , address=104.36.82.6:4895 , piece_id=AEAOXR6IB67C7CWDHNUCMSJNNZWBVSTABYJXQZONOGW72KWXSGKQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:35.413610316 (84h29m45.136173346s) [noise=true , address=104.36.82.15:4273 , piece_id=27R6GHAA66S3GXW4CDROPL2VQ2WYHVXVXWUBQJLS6TW2OPWBJQQA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:36.109525520 (84h29m45.83208856s) [noise=true , address=104.36.82.12:4158 , piece_id=BART7PK3BNOR4BFLXGJNKHLD5R2UIJA726WPZTGRX72ZWWILHGOQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:05:38.196788062 (84h29m47.919351102s) [noise=true , address=104.36.82.5:4860 , piece_id=EHWCFQCOMXQC77NUXSNMXNC4CJDC4HLLUQTFO6LRO5KSYFMHVLXA, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:00.188535918 (84h30m9.911098959s) [noise=true , address=104.36.82.55:4213 , piece_id=TVWUTOKKRQ54KEFZE6VIJV35CYJ3WSA4774PQQJQICJC2BWXH35Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: <nil> Jul 28 00:06:06.210902795 (84h30m15.933465835s) [noise=true , address=104.36.82.52:4089 , piece_id=G66HWMLY3LLWZLX7TOGZ6M3JBG2ED5T2XTRHE5F4LMPYH25YUJFQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:104.36.82.52:4089): protocol: write tcp 188.166.225.170:55522->104.36.82.52:4089: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211026813 (84h30m15.933589853s) [noise=true , address=104.36.82.46:4485 , piece_id=ZE645V4MMPB3HRBP6NQDT3CYRXAODFQ47RXOZ6LFEW4VKQSGG42A, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, address:104.36.82.46:4485): protocol: write tcp 188.166.225.170:47740->104.36.82.46:4485: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211076278 (84h30m15.933639318s) [noise=true , address=104.36.82.21:4474 , piece_id=KSLCLFIWUR4HQPHHMMFNNUGAX2TBVNVNSE6JOQIBXWJQ3KNLZ3LQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:104.36.82.21:4474): protocol: rpc: dial tcp 104.36.82.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211129189 (84h30m15.933692229s) [noise=true , address=104.36.82.54:4186 , piece_id=GRZ2IZTALNU5WIYRKKSMTDAFTXSOFX67BAQF7YUKFW434JGCFWLQ, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:104.36.82.54:4186): protocol: rpc: dial tcp 104.36.82.54:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211185176 (84h30m15.933748216s) [noise=true , address=104.36.82.11:4132 , piece_id=BQTGHIPT2J7ILU2GVJ3J3W4T6KAKT6E27KWLQBJCEQ5K6IOT7F4Q, seg_pos={0 0}, upload=81093]: Done uploading piece. err: ecclient: upload failed (node:17856PRHooRiPyrBYLJggh5uYpdWA9CnGxgCrmVesToNu7FeLb, address:104.36.82.11:4132): protocol: write tcp 188.166.225.170:59180->104.36.82.11:4132: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:06.211199904 (84h30m15.933762944s) [seg_pos={0 0}, upload=81093]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 28 00:06:06.439347605 (84h30m16.161910645s) [upload=81093]: Done uploading segments... Jul 28 00:06:06.439375689 (84h30m16.161938729s) [upload=81093]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.23388019s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X.......................................X.......] duration: 1.938795066s FAIL (2025-07-28 00:06:00 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.938830442s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X.......................................X......] duration: 1.91882119s FAIL (2025-07-28 00:05:31 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.918839947s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X.......................................X.....] duration: 1.822151258s FAIL (2025-07-28 00:04:21 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.822180816s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X.......................................X....] duration: 1.855264813s FAIL (2025-07-28 00:03:18 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.855324978s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X.......................................X...] duration: 1.834080713s FAIL (2025-07-28 00:02:42 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.834103266s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X.......................................X..] duration: 2.031033589s FAIL (2025-07-28 00:01:48 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 2.031060382s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X.......................................X.] duration: 1.845505902s FAIL (2025-07-28 00:01:03 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.845543524s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X.......................................X] duration: 1.594266177s FAIL (2025-07-28 00:00:00 UTC) orbiter warning: digest mismatch: after 1e6ef078352c9b2975a9c3c70a268672ca4ab648412c35b42847b75d0b8257ac != before 9191ebf3d32f55084dcb54ce27fbde61a16302bd0d2184d4ea9d433f96c50ecc Duration: 1.594292516s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.853665053s FAIL (2025-07-27 23:58:56 UTC) orbiter warning: uplink: too many requests Duration: 1.853691693s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.842986972s FAIL (2025-07-27 23:58:36 UTC) orbiter warning: uplink: too many requests Duration: 1.843041116s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.805045356s FAIL (2025-07-27 23:58:35 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 5.805070934s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.783344735s FAIL (2025-07-27 23:57:40 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 5.783385363s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.967219445s FAIL (2025-07-27 23:57:39 UTC) orbiter warning: uplink: too many requests Duration: 1.967469633s core uplink us1 vivint

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)