Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 496467 reports (Page 5646 of 9930)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
5.960109873s
FAIL (2025-10-13 21:24:37 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 5.960142906s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
5.98246345s
FAIL (2025-10-13 21:24:05 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 5.982497876s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
6.059864303s
FAIL (2025-10-13 21:22:52 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.059895781s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
6.229357784s
FAIL (2025-10-13 21:22:18 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.229378823s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001811315s
FAIL (2025-10-13 21:22:12 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119    , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082    , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771     , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225    , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009     , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626     , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662     , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843     , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187    , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295    , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150    , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876   , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078   , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005   , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186    , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223    , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 30.00183562s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
6.09066351s
FAIL (2025-10-13 19:07:40 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.090692687s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
6.128181307s
FAIL (2025-10-13 19:07:15 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.128211995s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
6.065367254s
FAIL (2025-10-13 19:06:06 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.065398964s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
6.104671146s
FAIL (2025-10-13 19:05:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.10470482s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
6.729895s
FAIL (2025-10-13 19:04:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.729928332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
6.133495875s
FAIL (2025-10-13 19:04:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.133531572s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
6.215921896s
FAIL (2025-10-13 19:03:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.215954429s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
6.265894013s
FAIL (2025-10-13 19:02:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.265936665s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
6.116092693s
FAIL (2025-10-13 19:01:22 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.116121738s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
6.062791359s
FAIL (2025-10-13 19:00:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.062829141s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
6.197487003s
FAIL (2025-10-13 18:59:42 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.197525186s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
6.050608169s
FAIL (2025-10-13 18:59:26 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.050660649s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.949411892s
FAIL (2025-10-13 18:59:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.949444703s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
6.292859531s
FAIL (2025-10-13 18:58:47 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.292897625s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
6.19896735s
FAIL (2025-10-13 18:58:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.19900411s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
6.01262436s
FAIL (2025-10-13 18:57:05 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.012657234s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
6.092581396s
FAIL (2025-10-13 18:56:48 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.092616543s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
6.239026948s
FAIL (2025-10-13 18:55:47 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.239142939s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
6.167816726s
FAIL (2025-10-13 18:54:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.167847055s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
6.023288958s
FAIL (2025-10-13 18:54:04 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.023322804s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
6.099368507s
FAIL (2025-10-13 18:52:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.099399355s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
6.190981677s
FAIL (2025-10-13 18:52:32 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.191048794s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
6.049933607s
FAIL (2025-10-13 18:51:39 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.049983913s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
6.061590642s
FAIL (2025-10-13 18:50:43 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.061621261s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
6.073551779s
FAIL (2025-10-13 18:49:42 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.073582537s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
6.080138519s
FAIL (2025-10-13 18:49:16 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.080185328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
6.215991534s
FAIL (2025-10-13 18:48:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.216023345s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
6.00229086s
FAIL (2025-10-13 18:47:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.002314085s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
6.17447913s
FAIL (2025-10-13 18:47:13 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.174511773s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
6.08125755s
FAIL (2025-10-13 18:46:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.081289811s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
6.00221736s
FAIL (2025-10-13 18:45:15 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.002261093s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
6.059518833s
FAIL (2025-10-13 18:44:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.05954845s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
6.301968498s
FAIL (2025-10-13 18:44:05 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.302025857s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
6.049836065s
FAIL (2025-10-13 18:43:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.049866664s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
6.020027053s
FAIL (2025-10-13 18:42:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.020059336s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
6.104167644s
FAIL (2025-10-13 18:42:23 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.104205908s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
6.152330025s
FAIL (2025-10-13 18:41:23 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.152361333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
6.068482504s
FAIL (2025-10-13 18:40:13 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.068518521s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
6.229651891s
FAIL (2025-10-13 18:39:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.229688892s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
6.62074993s
FAIL (2025-10-13 18:38:36 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.620782071s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
5.941170255s
FAIL (2025-10-13 18:38:00 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.941205694s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
6.134349658s
FAIL (2025-10-13 18:37:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.134380758s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
6.074400726s
FAIL (2025-10-13 18:37:11 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.074437748s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
6.142417681s
FAIL (2025-10-13 18:36:20 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.142476482s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
6.370654257s
FAIL (2025-10-13 18:35:09 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
nt. Inline: false
Oct 13 18:25:46.984847801 (484h54m32.446940284s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 18:25:46.984852559 (484h54m32.446945032s) [upload=426671]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 18:25:47.301070679 (484h54m32.763163152s) [seg_pos={0 0}, upload=426671]: Begin upload segment...
Oct 13 18:25:47.301351714 (484h54m32.763444188s) [seg_pos={0 0}, upload=426671]: Done begin upload segment.
Oct 13 18:25:47.301387202 (484h54m32.763479685s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.301413872 (484h54m32.763506355s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302165884 (484h54m32.764258357s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302283147 (484h54m32.76437562s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.302774533 (484h54m32.764867006s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.303239609 (484h54m32.765332082s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.304228712 (484h54m32.766321195s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305476438 (484h54m32.767568911s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.305896097 (484h54m32.76798857s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.306465883 (484h54m32.768558356s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.307771639 (484h54m32.769864112s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.308472714 (484h54m32.770565227s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309138491 (484h54m32.771230974s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309676186 (484h54m32.771768659s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.309839045 (484h54m32.771931528s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:47.310425081 (484h54m32.772517554s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Uploading piece...
Oct 13 18:25:48.988360660 (484h54m34.450453133s) [upload=426671]: Next returned nil segment
Oct 13 18:25:48.988380088 (484h54m34.450472561s) [upload=426671]: Waiting for error group managing segments...
Oct 13 18:25:49.384871743 (484h54m34.846964216s) [noise=true , address=45.91.116.9:4262     , piece_id=KM2OIHD6NJEP64XM5OOMEBKMLCPB7JJRB3AJPN5CINKYTWLOBAWA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.417964057 (484h54m34.88005653s) [noise=true , address=77.90.31.21:4878     , piece_id=Y4TI5ZOK3FNYJ5HDYBYLLHO3OXLMVQJRHAWNVIIF3UODIVO52UEA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.427905568 (484h54m34.889998051s) [noise=true , address=45.91.116.6:4973     , piece_id=6BUZVAVTALE3Y3N7CUVBOJXA3YACKLYLI46JEGIFJV5QGKCQLMTQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.452333814 (484h54m34.914426287s) [noise=true , address=77.90.31.14:4662     , piece_id=2R4HKV3M6K3KJKLI6OXY3GYV2ZQYYW4JW2Y3FMPKIJTEYNQDCFAQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.479665108 (484h54m34.941757581s) [noise=true , address=45.91.116.11:4119    , piece_id=T4GZJIKT2MO6NRIZ6GS6UVDJBNLPLZSJZEAPJJXF2GO6DOMXKWYA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504281031 (484h54m34.966373514s) [noise=true , address=77.90.31.15:4698     , piece_id=HCEVMD7LMFPMJVJXUNV2VXGCY7UN57RXPEY7QL2YVGK5GP7EK67Q, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:49.504561375 (484h54m34.966653858s) [noise=true , address=77.90.31.16:4734     , piece_id=UCOISCVF3CSTMHHKTDDO24UU5RDKSRRFJWHUXZJKFQC3D7NT32MQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:25:51.086212813 (484h54m36.548305297s) [noise=true , address=45.91.116.5:4297     , piece_id=WUPPZCZABLY725ZDFDCZY3N3ILTAADJKKJ6PZRVSDOZVLRZKWPLQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: <nil>
Oct 13 18:26:16.280571956 (484h55m1.742664439s) [noise=true , address=145.79.227.17:4969   , piece_id=EJHD3MZ73EVWSNLZHWAW2KISOMOWYSJF2DF2ZTSOBXICZIMJICIA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:59406->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280720459 (484h55m1.742812942s) [noise=true , address=145.79.227.6:4258    , piece_id=BJY3JTTIOLR3FTJ7R45ESDZJ4OLZDLLLIVHIE447YIZSF33MDAEQ, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:58264->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280851589 (484h55m1.742944072s) [noise=true , address=145.79.227.11:4730   , piece_id=KMFNAZYBJZDLVCOCKGOZWYRR3UO3DAVSNRLEWFHAEXXDMOM4FYXA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:57058->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.280976557 (484h55m1.74306905s) [noise=true , address=145.79.227.17:4971   , piece_id=KU4OXURLIFEIPDHM4H5WGAHIRCNPRIJARIJC4WJ45BOIBTDO5PUA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:49498->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281089262 (484h55m1.743181745s) [noise=true , address=145.79.227.5:4223    , piece_id=VML5X2QI7QZAZQPAP7WF3Q3I56G3MB3ZEDOQMU6VPCCVGGOUGSCA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33458->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281305784 (484h55m1.743398287s) [noise=true , address=145.79.227.16:4909   , piece_id=VCW3JKKGRN53JKRLBCIVWFYFEZJZAOMCZW3CLW3DZ5XLVBO3K63A, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: read tcp 188.166.225.170:44512->145.79.227.16:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281413018 (484h55m1.743505501s) [noise=true , address=145.79.227.17:4972   , piece_id=R4UIR5LKXWWD6GT2E3PD5ZVTIAFOAZI32TIOCXLSKEGQAMAY2QBA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: read tcp 188.166.225.170:43074->145.79.227.17:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281524770 (484h55m1.743617253s) [noise=true , address=145.79.227.6:4259    , piece_id=XHPP5RAQQH42WZZF764ENYFYYDTKDN47XIIQ3O2EXOQH4JNDBDOA, seg_pos={0 0}, upload=426671]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 13 18:26:16.281554317 (484h55m1.7436468s) [seg_pos={0 0}, upload=426671]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Oct 13 18:26:16.531473190 (484h55m1.993565673s) [upload=426671]: Done uploading segments...
Oct 13 18:26:16.531508868 (484h55m1.993601351s) [upload=426671]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.37069302s core uplink us-select-1