Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.883430218s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:59:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.883465977s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 4.653417601s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:59:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.653439353s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.823037193s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:59:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.823060096s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 4.627161102s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:58:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.627179838s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.670972543s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:58:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.671002902s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.786111296s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:58:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.786161234s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.785251519s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:57:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.785276967s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.651608692s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:57:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.651640023s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.972088367s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:57:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.972114999s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.798743596s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:56:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.798769435s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.189748778s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:56:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.189770641s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.592099124s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:56:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.592117028s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.600902404s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:56:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.600927954s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.804892852s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:55:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.804914916s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 4.55182192s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:55:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.551847449s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 9.104329673s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:54:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 9.104344872s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 4.635111594s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:54:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.63513582s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.371720069s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:54:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.371733033s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.180286113s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:54:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.180315149s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.868803818s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:53:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.86882612s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 4.812288161s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:53:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.812316124s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.789204568s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:53:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.789220868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.805543744s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:52:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.805569614s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.250709345s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:52:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.25073705s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.273757788s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:51:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.273783769s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 10.638351024s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:51:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 10.638371462s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.636370404s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:51:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.636396444s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.776471421s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:50:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.776496369s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.791370217s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:50:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.791403192s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.877446756s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:50:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.877472917s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.238467753s trace: https://jaeger.dev.storj.io/trace/785f6ba3defbc5f1 FAIL (2026-04-07 16:49:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 7 16:49:16.404046599 (1h3m3.223282633s) [upload=1004]: Starting upload Apr 7 16:49:16.404142144 (1h3m3.223378198s) [upload=1004]: Done starting upload Apr 7 16:49:16.404219263 (1h3m3.223455317s) [upload=1004]: Uploading segments... Apr 7 16:49:16.404478854 (1h3m3.223714908s) [upload=1004]: Got next segment. Inline: false Apr 7 16:49:16.404524161 (1h3m3.223760205s) [upload=1004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 7 16:49:16.404529973 (1h3m3.223766027s) [upload=1004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 7 16:49:16.639534974 (1h3m3.458770998s) [seg_pos={0 0}, upload=1004]: Begin upload segment... Apr 7 16:49:16.639590170 (1h3m3.458826194s) [seg_pos={0 0}, upload=1004]: Done begin upload segment. Apr 7 16:49:16.639636260 (1h3m3.458872284s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.639668131 (1h3m3.458904145s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640164048 (1h3m3.459400072s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.640618686 (1h3m3.45985471s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641539182 (1h3m3.460775206s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.641906561 (1h3m3.461142585s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642847046 (1h3m3.46208307s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.642994992 (1h3m3.462231006s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.643898585 (1h3m3.463134609s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.644031492 (1h3m3.463267506s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.645263680 (1h3m3.464499704s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.646438297 (1h3m3.465674321s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.647640607 (1h3m3.466876631s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.648547488 (1h3m3.467783512s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649540304 (1h3m3.468776328s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:16.649897263 (1h3m3.469133287s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Uploading piece... Apr 7 16:49:18.453966670 (1h3m5.273202694s) [upload=1004]: Next returned nil segment Apr 7 16:49:18.453979515 (1h3m5.273215539s) [upload=1004]: Waiting for error group managing segments... Apr 7 16:49:18.745383994 (1h3m5.564620018s) [noise=true , address=77.90.31.10:4521 , piece_id=PEHUB3OSJ4EPK5B75GLW4WR4XYGZWHD3IDGIQ4CEU7OBV3I2IBIQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.747854502 (1h3m5.567090526s) [noise=true , address=77.90.31.19:4844 , piece_id=QZDTDYISTBTFLU32Z3RZKXLE5FCQD4DKDQOQ2G3REDSG4ANS46FA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:18.768878677 (1h3m5.588114702s) [noise=true , address=77.90.31.16:4738 , piece_id=JINVXXMWNA3E23IGCRLFSEN664BIAKX52DN3VWMEB6T2X42PHXBQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:39.670772355 (1h3m26.490008379s) [noise=true , address=145.79.227.11:4733 , piece_id=MKM2QZNCPJ5HC2GVKHITLVRF34VRB67Z6AEF3STF3R6IRKE3B7DA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:42.424235370 (1h3m29.243471404s) [noise=true , address=145.79.227.29:4944 , piece_id=QREVJYVYGGKH3TG5IBP2HQDNJU3W3SXOWJXFMORASENU4ONPBWDA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.664476934 (1h3m30.483712958s) [noise=true , address=145.79.227.50:4378 , piece_id=GYCPG243LNFAYIHDBNPFBU4HSOGOQJSIOT4UJS6QIQBSBY6NZJHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:43.795878559 (1h3m30.615114583s) [noise=true , address=145.79.227.15:4876 , piece_id=GL6ZIB2QRAFTME5ANWMTYUCXQVU7B2XFRBSZNPYGM46A3DN7WTEQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.239694270 (1h3m31.058930294s) [noise=true , address=145.79.227.5:4227 , piece_id=PMC56VGIABIX6WYKHW7VSXCGJPBDNBMQ2T746XZFHJXBL7CR6RKA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:44.551105732 (1h3m31.370341756s) [noise=true , address=145.79.227.12:4768 , piece_id=YBAYELGTCBHJ35UT7EIYETE33VAHSI2MCAKZ2XW4DWP6WGPKZPBA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.227305947 (1h3m32.046541981s) [noise=true , address=145.79.227.25:4620 , piece_id=XNLVCKOIZ24PLNFRVUJYHQKH2BXXBSO7E7YXIOLKYNEMHEFZT4UA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.298858969 (1h3m32.118094993s) [noise=true , address=145.79.227.16:4910 , piece_id=F3A4X7MUA4YG5X6I7LKWM2XQQVX6KSEOZVMY7LJH7ZGRQYUDJ4HQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: <nil> Apr 7 16:49:45.734736790 (1h3m32.553972814s) [noise=true , address=145.79.227.33:4870 , piece_id=6EKU6E4PVRI46YYBM6CXJBBV7YHOSYWKPR3FBAGJEH56VVHRPEHA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; context deadline exceeded; EOF Apr 7 16:49:45.734897671 (1h3m32.554133705s) [noise=true , address=145.79.227.14:4843 , piece_id=OQT4LCPNSZ23F2KIIVJC255UQCL4DD56ZYYZFWKKOO7F7J54N6DQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735066466 (1h3m32.55430249s) [noise=true , address=145.79.227.27:4695 , piece_id=T3H7HF26ACJSLTAZOCHOZZEZCCMO3OY2D2GMFGHKZSLZLBTZ2KFQ, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47910->145.79.227.27:4695: use of closed network connection Apr 7 16:49:45.735182671 (1h3m32.554418695s) [noise=true , address=145.79.227.42:4124 , piece_id=PFX7IKMVW66T36XQIBTHDG7V26AEQJ6BFHPZM4PY2DXEHERANIIA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: rpc: dial tcp 145.79.227.42:4124: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 7 16:49:45.735192710 (1h3m32.554428734s) [noise=true , address=145.79.227.22:4512 , piece_id=RSBEQABUZZ5FDF6DUTJK4UKBMJ4TYRVVNWWABVESMD2H7LXT45YA, seg_pos={0 0}, upload=1004]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52620->145.79.227.22:4512: use of closed network connection Apr 7 16:49:45.735217338 (1h3m32.554453362s) [seg_pos={0 0}, upload=1004]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 7 16:49:45.971281875 (1h3m32.790517899s) [upload=1004]: Done uploading segments... Apr 7 16:49:45.971313286 (1h3m32.79054931s) [upload=1004]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.238495536s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.849976492s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:49:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.850002584s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.660112287s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:48:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.660139389s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 4.530549071s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:47:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.530571616s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 4.212665057s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:46:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.212689004s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.582983473s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:45:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.583004794s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 4.601933087s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:44:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.601957473s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.664083793s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:44:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.664106878s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 4.730403162s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:43:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.730429815s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.09531136s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:42:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 5.095334625s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.273170403s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:42:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 5.273197126s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 4.66236247s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:40:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.662385915s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.685680449s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:40:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.68570728s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.721145787s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:39:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.721172619s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.243737011s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:38:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.243765547s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.12680213s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:38:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.126824263s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.54995987s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:37:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.549983706s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.489995146s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:37:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.490020084s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.477055341s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:36:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.477081512s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.165765553s trace: https://jaeger.dev.storj.io/trace/64b6d1a54716ba0f FAIL (2026-04-07 16:35:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== se=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.118413359 (35m14.937649383s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119467614 (35m14.938703638s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.119845633 (35m14.939081657s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.120921810 (35m14.940157834s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121196580 (35m14.940432604s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.121881281 (35m14.941117305s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.134492200 (35m14.953728234s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.138875619 (35m14.958111643s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.141387237 (35m14.960623261s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.142054305 (35m14.961290329s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.143391034 (35m14.962627058s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Uploading piece... Apr 7 16:21:28.937935313 (35m15.757171337s) [upload=556]: Next returned nil segment Apr 7 16:21:28.937955211 (35m15.757191235s) [upload=556]: Waiting for error group managing segments... Apr 7 16:21:29.312490535 (35m16.131726559s) [noise=true , address=185.167.204.205:4028 , piece_id=AV3KDMN5QMV4HWQNPXFIUD5LCBQKBSRVO5RUWPN6SM2SKSJNAO6A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.313065515 (35m16.132301539s) [noise=true , address=81.171.14.70:4043 , piece_id=GAR4NCZ6ALRRR5G6JM4TFEN6GQVKQT6VP7T54NQCC3WDXMK4Y2LQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.317581080 (35m16.136817104s) [noise=true , address=185.167.204.206:4072 , piece_id=TIU4ZIA3NXF2ESAYWSXR43VRGEGRF7ZUJBXMMC5NVUIINVL6JD4Q, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321002303 (35m16.140238327s) [noise=true , address=185.167.204.206:4051 , piece_id=WKE2A6H7375NX26TZFY2OVS7UGKHXXYN5ECT7MY4O4CMQERJRFEQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.321055865 (35m16.140291889s) [noise=true , address=185.167.204.205:4036 , piece_id=LSZX5TTWNVSMLDW44L6SZLYYM5M5ASLKB7DKU6ITZBU3OYHH3HGA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.324331908 (35m16.143567932s) [noise=true , address=185.167.204.205:4035 , piece_id=KHV5JSCALSDSYUQOP3TRHYJBICOJN6I7SMWKOK4VD73QWXOUR3OA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.329100491 (35m16.148336515s) [noise=true , address=185.167.204.206:4066 , piece_id=HOJZY7DRKWET3YEHY4PBKYY7XXBA3QQUFOA4IHZSVYTNODPHAHUA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330156890 (35m16.149392914s) [noise=true , address=81.171.14.70:4045 , piece_id=YBI5OENLWNBBIMAYTJBT3S34EIYJA4DS5TYNOG36YHJQG7YOXQAQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.330725648 (35m16.149961672s) [noise=true , address=185.167.204.205:4011 , piece_id=DZMWRF3SAO3REB3LI7P6SSKOPQ2WF3RQK63RZX42JJ23PSBVGJCA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.333450476 (35m16.1526865s) [noise=true , address=185.167.204.205:4027 , piece_id=HEGEZPSFSPLHF2JWZJTSCNREQKPZOZKSSFZVTJIUCHZK2CHIKDIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.335058369 (35m16.154294394s) [noise=true , address=81.171.14.70:4047 , piece_id=767OLMRS5NK2RAT2OWZACLLEWEHW2VNYDUXWFM5LMLODWMSKGNYQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.336355844 (35m16.155591868s) [noise=true , address=185.167.204.206:4052 , piece_id=OE6LO4OZUYQST7H3WK7YIBUAQV7OJ36AVWPCK5FDDUDNWFQ7TTRQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.342177569 (35m16.161413593s) [noise=true , address=185.167.204.205:4016 , piece_id=JPEH7OZIHJ2W4NVI7ADOWNUBTRN3HFOPCBN2IMESK73LSYZVLVXA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.344266711 (35m16.163502735s) [noise=true , address=81.171.14.70:4028 , piece_id=L7DZJJHTRPFTDC7OGR4BWV5DLPHB57UF2CZOQ7N3B7BSYB5AAIIA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.346698033 (35m16.165934058s) [noise=true , address=185.167.204.206:4041 , piece_id=36TBTTROEXWWUBP5QM2YE5PKK2OZNXGK2RWLCDLYOWXFRZJTRJKA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.347212697 (35m16.166448721s) [noise=true , address=81.171.14.70:4029 , piece_id=3HJW4JLKGIFWYIVIGYGQ7KC3FZYRBRTVDW2MIRS7IMDYRCSYOFJA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.348676903 (35m16.167912927s) [noise=true , address=81.171.14.70:4044 , piece_id=UXPMRRLQSAVSJE7OFP3RQP35SM2ZQW4X27WXAT4AMHIUEUP7YJJQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.350418072 (35m16.169654096s) [noise=true , address=81.171.14.70:4042 , piece_id=U42Y7SZ6Q3HJXSWYI5FQU4JWGV3YIC4P3PQHWDJOPJLC7IOXO3NQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.356302659 (35m16.175538683s) [noise=true , address=185.167.204.206:4054 , piece_id=NTWU2AEXYICYI3XM7QTPUYP5Z3ZARACBOEHIXD4TLAA7FCO3VGVQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.366732939 (35m16.185968963s) [noise=true , address=81.171.14.70:4046 , piece_id=P26WFAD5SIA2G5UFTTD37F37R7OTQNCN63HFGVQOHD76DKZD3IVA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.376711186 (35m16.19594722s) [noise=true , address=81.171.14.70:4041 , piece_id=MCDBF47JBZ7YUPZN2RWCZ5X4M633CLKKQQB2TFNEW4WPX5J2TDIQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.377960888 (35m16.197196912s) [noise=true , address=81.171.14.70:4031 , piece_id=O7EI6YBE4WYU4X7JQRCKBG75FCTUGB5LLUHY3CAF74X2PXJXF5HA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.390393201 (35m16.209629275s) [noise=true , address=81.171.14.70:4027 , piece_id=HFXX2ZH7VHF3RG6XWKMEZ2X6DSV4BAPGI7BUY4FM7S3XDC3NAJHA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.931810796 (35m16.751046821s) [noise=true , address=89.149.201.147:4013 , piece_id=EVY4T75Y7IS6ZFYIVCTWQRDMI4QXTZJNFMHVUQM4P4NCNGIH66YA, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.932105245 (35m16.751341279s) [noise=true , address=89.149.201.147:4017 , piece_id=MKKS55BXOPL5T5VGY2TWAZ4JHPGBVNZ6TTQQR5BG6KCSIBVE3Q2A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963229903 (35m16.782465937s) [noise=true , address=89.149.201.147:4022 , piece_id=5PDJX7FSNAYMNHBST2GMTWQDYGHDWZ7ZBMYEP3I3OULC7HEM366A, seg_pos={0 0}, upload=556]: Done uploading piece. err: <nil> Apr 7 16:21:29.963251204 (35m16.782487228s) [seg_pos={0 0}, upload=556]: Satisfied cohort requirements after 26 pieces Apr 7 16:21:29.963526916 (35m16.78276294s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963532977 (35m16.782769001s) [noise=true , address=89.149.201.147:4010 , piece_id=V3UXPI4LFLCLDZAVET55IASXQNZTRVIRLGGAJ6SSBS4F5ZV6YPBA, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963641156 (35m16.78287718s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF Apr 7 16:21:29.963658900 (35m16.782894934s) [noise=true , address=89.149.201.147:4020 , piece_id=PBT4IKXSFWOXKPALXZ5BA66WCONDDOCDPUL63S7F5ETECFUOACBQ, seg_pos={0 0}, upload=556]: Long tail cancellation due to optimal threshold Apr 7 16:21:29.963685763 (35m16.782921787s) [seg_pos={0 0}, upload=556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 7 16:21:29.963796757 (35m16.783032781s) [upload=556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 7 16:21:29.963801927 (35m16.783037951s) [upload=556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 7 16:21:30.803128443 (35m17.622364467s) [upload=556]: Done uploading segments... Apr 7 16:21:30.803195572 (35m17.622431596s) [upload=556]: Upload finished. err: metaclient: context canceled Duration: 4.165788288s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)